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Preface 


This book showcases the unsurpassed effectiveness of employing topological 
methods in studying the stabilization of nonlinear dynamical systems. Strikingly, 
one observes a stark difference in the ramifications of controllability for either linear 
or nonlinear systems. For linear dynamical systems, controllability implies the exis- 
tence of a continuous, globally asymptotically stabilizing feedback. On the other 
hand, for controllable nonlinear dynamical systems, there might not exist a feedback 
that is both continuous, globally well-defined and stabilizing in the asymptotic sense. 
This can be understood from the topological viewpoint. 

A thorough understanding of this phenomenon is of great importance as control 
theoretic tools are being applied to systems of ever-growing complexity whilst 
demanding increasingly strong guarantees, e.g., in the context of algorithm design, 
ecology, reinforcement learning, robotics and so forth. With the increase in appli- 
cations—especially the ones outside of the traditional control domain—comes the 
responsibility of precisely detailing what the tools can and cannot do. Failing to do 
so can have catastrophic consequences, e.g., incorrectly assuming that global stabi- 
lization is possible based on merely numerical simulations. In other words, given 
a control system, can some desirable dynamical behaviour possibly be prescribed? 
Here, the desirable behaviour can oftentimes be captured by the stability or stabi- 
lization of some set. For instance, the stationary pumping of the heart and the gait of 
a walking robot can be captured by the stability and stabilization of a periodic orbit, 
respectively. 

Ever since the time and work of Poincaré, it has been known that one can greatly 
benefit from the qualitative viewpoint in studying such a question of admissible stable 
behaviour. Doing so, topological methods present themselves as natural method- 
ological candidates as these tools allow for drawing strong qualitative conclusions 
based on merely elementary structural knowledge of the control problem at hand. 
This study took off in the second half of the 1900s and rapidly brought about a 
vast amount of work in the intersection of control theory, dynamical systems and 
topology. To this day, this line of work provides for generic and unique insights 
in theoretical and applied control, e.g., necessary conditions for continuous asymp- 
totically stabilizing feedback controllers to exist. Unfortunately, most of the results 
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are not as widely known as desirable. Hence, motivated by this observation and the 
theoretical and applied prospects, we believe this is the right time to provide the first 
unified and complete overview of topological methods in studying nonlinear stability 
and stabilization. 

Specifically, this monograph aims to provide a self-contained overview accessible 
to the graduate student interested in control theory. In particular, this work aims to 
provide a unified overview of topological obstructions to stability and stabilization of 
dynamical systems defined on topological spaces. We review the interplay between 
the topology of an attractor, its domain of attraction and the underlying topological 
space, e.g., a manifold, that is supposed to contain these sets. Some proofs of known 
results are presented to highlight assumptions and to develop extensions. To be as 
complete as possible, we also provide a few new results and we highlight the most 
popular and effective methods regarding how one can overcome these topological 
obstructions. Moreover, we show how Borsuk’s retraction theory and the index theo- 
retic methodology by Krasnosel’skii and Zabreiko underlie a large fraction of results 
known today. This point of view naturally reveals important open problems and as 
such we believe that this work could be of interest to any student and researcher in 
control theory, dynamical systems, topology or a related field. 


Lausanne, Switzerland Wouter Jongeneel 
Poitiers, France Emmanuel Moulay 
February 2023 
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Chapter 1 A) 
Introduction E 


1.1 Impetus 


From climate models to walking robots and from black holes to the economy; many 
objects of science are studied by means of dynamical systems evolving on mani- 
folds [40, 105, 151, 156]. As models are not perfect and explicit solutions are rare, 
ever since the time of Poincaré the interest shifted from studying the quantitative- 
to studying the qualitative behaviour of a dynamical systems at hand. Not only the 
description of a system, but in particular, the prescription of the dynamics of a system 
became of increasing importance. Naturally, one must ask if the desirable dynamics 
are admissible in the first place. Topology provides for a rich set of answers relying 
on a minimal set of assumptions, as surveyed in this work. 

Given some space M and some subset A of M. We will be mostly concerned with 
studying if M admits a dynamical system such that the set A, e.g., some configuration 
of a robot, is (uniformly) globally asymptotically stable. This stability notion is 
captured by: (i) Lyapunov stability: that is, for each neighbourhood U of A there is 
another neighbourhood V C U of A such that when the system starts from a state 
within V, the state of the system will stay in U; and (11) attractivity: that is, there is 
a neighbourhood W of A such that when the system is started from a state within 
W, the state of the system converges asymptotically to A. When W = M, we speak 
of global asymptotic stability. We also remark that Lyapunov stability is sometimes 
referred to as simply stability, consequently, a set that fails to be stable, with respect 
to some dynamical system, is said to be unstable. For formal definitions, see Chap. 5. 


Example 1 (Admissible flows on the circle) Let one be tasked with finding a con- 
tinuous flow, i.e., a map that defines state propagation as a continuous function of 
the time to propagate and the instantaneous state, such that some point p* on the 
circle S! is globally asymptotically stable, e.g., see Fig. 1.1(i). The flow in any small 
neighbourhood around p* is well-defined, but one eventually runs into problems, see 
Fig. 1.1(ii), and cutting the circle (allowing for discontinuities) seems the only solu- 
tion, see Fig. 1.1(iii). Although, relaxing the task, e.g., by allowing for almost surely 
global asymptotic stability, local asymptotic stability or merely global attractivitiy 
(no Lyapunov stability), also belongs to the possibilities, see Fig. 1.1(iv)—-(vi). In 
fact, by studying Fig. 1.1 one might observe some patterns, e.g., stable and unstable 
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Fig. 1.1 Example 1, (asymptotically) stabilizing p* € S! 


equilibrium points necessarily come in pairs. The key observation, however, is that 
for compact nonlinear spaces, the study of global behaviour should take the global 
topology into account. 


Example 1 illustrates the fact that merely the underlying topology of a space can 
obstruct the existence of certain qualitative behaviour. 

Next, going one step beyond the circle, we consider the mathematical pendulum, 
cf. [142, 145], which displays a myriad of topological phenomena [97, 126] and 
captures the dynamics integral to the study of robotics, aerial vehicles and more. 


Example 2 (The mathematical pendulum) The single-link pendulum displays intri- 
cate nonlinear behaviour by having the circle S! as its configuration space. As a 
pendulum is a second-order system, the state space, however, becomes the cylinder 
S! x R, parametrizing the angle and rotational velocity, or as will be discussed, the 
trivial vector bundle z : S! x R —> S!. We assume that one can control the pendulum 
by means of a torque applied to its axis and that this torque is chosen as a continuous 
function of the state. Moreover, we assume that this feedback, i.e., the torque as a 
function of the state, gives rise to a continuous flow on S! x R and that there are 
isolated fixed points of the flow, e.g., we assume there is some form of friction. Now 
we ask a similar question as before, can the pendulum be globally asymptotically 
stabilized in the upright (0 = 0) position by such a feedback? This is a stabilization 
problem. For example, Fig. 1.2 displays trajectories analogous to Fig. 1.1(iv)-(v). 
The reader is invited to construct the phase portrait akin to Fig. 1.1(vi) and recover 
what is called the unwinding phenomenon. One observes that generalizing the circle 
to the non-compact cylinder did not improve the situation, topological obstructions 
prevail. Simultaneously, this example shows the power of this line of study in that 
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(i) 


Fig. 1.2 Example 2, asymptotically stabilizing the inverted pendulum 


the results are general; we did not yet make any explicit modelling assumptions, e.g., 
regarding friction and inertia. 


Example 2 sketches the practical value of studying topological obstructions; when 
explicit models are unknown or too uncertain, the underlying topology can already 
provide insights in admissible qualitative behaviour. In fact, one can argue that topol- 
ogy is the natural language to study these kind of dynamical problems [83]. 

The previous examples focus on equilibrium points, however, in many applica- 
tions one might be interested in stabilizing non-trivial periodic orbits or other sets. 
The intuition from before can be generalized, for example, consider globally asymp- 
totically stabilizing the circle S! in the plane R?. Again, obstructions of this kind are 
purely topological. 

Although results of this nature go back to the 1800s, we feel there is a need 
to survey existing material: the ever-growing field of applied dynamical systems 
theory, including, but not limited to, motion planning, numerical optimal control, 
system identification and reinforcement learning. The aforementioned observations 
have particularly important ramifications in those areas, as frequently, one needs to 
specify a space of models or policies to optimize over, a priori. 

As stressed in a recent article by Schoukens and Ljung [136], nonlinear system 
identification poses challenges beyond linear system identification, in particular, the 
nonlinear structure prohibits straight-forward extrapolation, that is, inferring global 
information from local data is inherently difficult in the nonlinear regime. However, 
knowledge of the underlying topological space is occasionally present, as such it is 
worthwhile to study ramifications of just the topological data at hand. 

Regarding policies, it is important to highlight that controllability merely implies 
the existence of some admissible input “steering point A to point B”. As stressed by 
Sussmann [146, p. 41], only when the admissible inputs are precisely detailed, one 
can study if some control objective can be satisfied by selecting the input as some 
kind of feedback controller. In practice, when numerically optimizing over policies, 
one is for example drawn to employing some form of function approximators [29]. 
It might be tempting to believe that the space of continuous functions is sufficiently 
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rich, however, as we already saw for the most elementary nonlinear manifolds, when 
stability is desired, this is not necessarily true. A similar argument can be made when 
searching for control-Lyapunov functions (CLF) or control barrier functions [88]. 
This work sets out to bring results of this kind further to the attention and spur more 
future work towards understanding and overcoming these topological obstructions. 
We will focus on continuous asymptotic stabilization of nonlinear systems. Here, 
nonlinear should be read as not necessarily linear. In particular, we look at dynam- 
ical systems defined on nonlinear spaces, e.g., as in Fig. 1.1, local linearizations 
can fail to capture topological impossibilities. The consideration of dynamical sys- 
tems is largely an attractive mathematical assumption, but one that is believed to 
be quintessential to better understand larger classes of physical systems. The focus 
on continuity is historically based on implementation and robustness considerations 
and seems at first a general assumption. Enforcing continuity allows for a better 
understanding of how general this assumption really is. The focus on continuity also 
puts work on neural networks in perspective as common architectures result in maps 
which are at least continuous. The desire of (uniform) asymptotic stabilization is a 
natural one from the classical mechanics point of view and enviable with respect to 
robustness, but also here one will observe that this demand can be too strong. 


1.2 Historical Remarks 


The study of topological obstructions in the context of dynamical control systems is at 
its core the investigation of what kind of—qualitative speaking—dynamical systems 
a space admits. Philosophically, this is in line with the early work on topology and 
dynamical systems as pioneered by Poincaré. To put the material in perspective, the 
next section briefly covers this history at large. 


1.2.1 Topology 


The fourth axiom of Euclid states “Things which coincide with one another are 
equal to one another” [4, p. 6]. Although Euclid was a geometer and no topologist, 
this axiom is broadly stating what topology would be all about. Yet, “things” and 
“equivalence” had to come a long way since the time of Euclid. 

In the early 1900s, Cantor started the development of set theory and contributed to 
the initial work on topology [31]. When Cantor his one-to-one map from the interval 
to the hypercube revealed the intricacies of defining dimension,' it was Dedekind to 
point out that perhaps something is missing: continuity [112]. Peano’s space-filling 
curve showed that even when continuity is satisfied (but injectivity is lost), counter- 


! Cantor famously wrote “I see it, but I don’t believe it” to Dedekind. See [49] for more context. 
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intuitive phenomena can still be observed [115]. These counterexamples revealed a 
lack of understanding when it comes to classifying objects as being “equivalent”. 

Poincaré was amongst the first to define, in for example his 1895 “Analysis situs”, 
what this equivalence could be: a continuous one-to-one transformation, called a 
homeomorphism [121]. It took, however, a while before a homeomorphism meant 
what it does today. Poincaré described analysis situs (the predecessor of topol- 
ogy, attributed to Listing) as “This geometry is purely qualitative; its theorems 
would remain true if the figures, instead of being exact, were roughly imitated by 
a child.” [123]. A weaker invariant that plays a substantial role in this work is that of 
homotopy. It can be argued that homotopies, albeit with fixed endpoints, originated 
in the work of Lagrange on the calculus of variations [41]. Although homotopies 
(described as continuous deformations), the fundamental group and initial homol- 
ogy theory appeared in the work of Poincaré [121], the formal description of what 
this “continuous deformation” is supposed to be, was missing. By building upon 
Schonflies, the concept of dimension that bothered Cantor, was eventually put on a 
theoretical footing by Urysohn [152] and most notably by Brouwer [25, 26] around 
1910, see also [72, Chap. 1]. This work by Brouwer also formalized homotopies and 
their equivalence classes as we know them today [27]. Besides, it brought forward the 
concept of degree, a notion of importance in this work, yet, a notion that was to some 
extent already known to Cauchy, Picard and in particular Kronecker [43, 114, 137]. 
Hurewicz added to this line of work by defining when spaces are homotopic [68] and 
a related theory, that of retractions was pioneered by Borsuk [16] in the late 1920s. 
A concept intimately related to the degree of a map is that of an index of a vector 
field, as arguably introduced by Poincaré and further developed by Hopf [66, 67]. 
An important elaboration and formalization is due to Brouwer [42, p. 168], Poincaré 
often assumed differentiability or even analyticity of objects under consideration [72, 
p. 57], while Brouwer relaxed this to mere continuity and was able to formally apply 
index theory to continuous vector fields on the sphere [26]. 

In the meantime topology branched out. Although the “Euler characteristic” was 
known, it can be argued that Riemann founded algebraic topology [17, pp. 162- 
164], as, amongst other things, he evoked, what would be called Betti numbers, in 
the late 1800s with his study into connectedness [130], [72, Chap. 2]. Generalizations 
required work from Betti [9], Poincaré [121] and most importantly, formalizations 
by Noether? [111] and later Eilenberg [45]. 

Formalizing the abstract study of sets relied on early work by Hilbert [61], 
Fréchet [46], Riesz [131] and in particular Hausdorff, whom in 1914 published 
Grundziige der Mengenlehre [56]. This was the first axiomatic work on abstract topo- 
logical spaces and can be seen as the start of general topology known today. Haus- 
dorff laid down the foundation of (general) topology and provided the neighbour- 
hood generalization of the Bolzano—Cauchy £ — ô continuity definition, although the 
neighbourhood concept was already known to some extent. 


2 For more context on Noether her contributions, e.g., in relation to pioneering work by Vietoris 
and Alexandroff & Hopf, see [64]. 
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Concurrently, the notion of a (linear) manifold was already known to Gauss, but, 
amongst others, it were Mobius [106], Jordan [74] and in particular Riemann [129] 
and Poincaré [121] that initiated the classification of manifolds. The theory of differ- 
entiable manifolds, however, and thereby differential topology was largely developed 
by Weyl [72, Chap. 2], Veblen and Whitehead (J.H.C.) [154] and Whitney [157, 158], 
e.g., this includes formalizations of coordinate charts, tangent spaces and embed- 
dings. The initial work by Cartan (Elie) on fiber bundles was further developed by 
Seifert, Whitney and Ehresmann [72, Chap. 22]. A later, but instrumental contribution 
for this work is the notion of transversality as developed largely by Thom [149]. The 
most important development for this work, and perhaps one of the most important 
series of results in the intersection of topology and dynamical systems in general, is 
the Poincaré—Hopf theorem, with contributions by Gauss, Kronecker, Bonnet, Dyck, 
Brouwer, Poincaré and in particular Lefschetz [93, 94] and Hopf [67], see also [48]. 

For these and more examples, see [42, 72, 137, 148, 155], the historical notes 
in [17, 43, 114, 163] and [124] for the English translation of [121]. Also, as high- 
lighted, topology thrived on counterexamples, which remained an active area [143]. 


1.2.2 Dynamical Systems 


Starting with Newton, the study of dynamical systems was dominated in the early 
days by the quantitative study of stability in the context of celestial mechanics. The 
complications that arise when trying to explicitly solve differential equations were 
early understood and amongst others, Laplace, Lagrange, Poisson and Dirichlet all 
claimed to have proven that the solar system was stable by means of analyzing series 
expansions, e.g., see the introduction in [1]. Motivated in part by a competition in the 
late 1880s hosted by Oscar II, the king of Sweden & Norway, it was Poincaré who 
pointed out that the series expansion approach of that time was flawed. As he puts 
it, “There is a sort of misunderstanding between geometers [mathematicians] and 
astronomers about the meaning of the word convergence.” “...take a simple example, 
consider the two series, 


1000" n! 
d TARAR? 
Lap PI Len TOG 


“geometers would say the first series converges, ...but they will regard the second 
as divergent. “Astronomers, on the contrary, will regard the first series as divergent 
as the first 1000 terms are increasing and the second as convergent as the first 1000 
terms are decreasing” (120, pp. 1-2]. Poincaré emphasized throughout his work that 
divergent series could have practical value, but to prove anything meaningful about 
the stability of the solar system required a rigorous mathematical justification [120, 
p. 2]. It was during this time that Poincaré developed his qualitative methods for 
mechanics and dynamical systems, e.g., [118—120, 122]. Amongst other things, in 
this work he started the classification of qualitative dynamical systems, introduced 
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the notion of the vector field index and advocated the use of transversality (Poincaré 
sections), topics we return to below. Ironically, the original version of the award 
winning? 1890 paper [118] did not contain the most celebrated parts of the work, 
e.g., work on homoclinic solutions (initially called doubly asymptotic solutions), 
only the corrected version did. Upon fixing the errors in the initial version of [118], 
Poincaré was puzzled by the chaos he created (found) and wrote to Mittag-Leffler 
“...I can do no more than to confess my confusion to a friend as loyal as you. I will 
write to you at length when I can see things more clearly.” [5, Sect. 5.8]. Almost ten 
years later, the situation was far from clarified, regarding homoclinic solutions to the 
three-body problem, Poincaré writes “One is struck by the complexity of this figure 
that I am not even attempting to draw.” (122, p. 389]. It would take more than half 
a century before Smale would clarify the situation. 

As remarked previously, one of the main topics of study has always been that of sta- 
bility. Around the same time as the early work of Poincaré, Lyapunov (Liapunov)— 
who was inspired by Poincaré [102, pp. 53 1-532]—published his thesis on qualitative 
stability theory in the early 1890s [99]. Although Lyapunov was the first to lay down 
the foundations, similar notions appeared in the work of Lagrange [90] and Dirich- 
let [44]. In this work, Lyapunov devised two lines of attack to reason about (local) 
stability. The first method (indirect) relies on linearizing the dynamics, whereas the 
second method (direct) is in the spirit of the work by Lagrange and looks for an 
“energy” function (Lyapunov function), which is strictly positive, yet decreasing 
along the dynamics. Attributed to Poission, Poincaré, however, spoke of stability 
of a point when a trajectory returned infinitely often to points arbitrarily close to 
where the point started from. Lyapunov spoke of stability of a point when for each 
open neighbourhood U around a point there is an open set V C U such that each 
trajectory starting in V remains in U. Lyapunov’s approach to stability (the second, 
direct method) had an intuitive and almost direct link to modelling paradigms in 
mechanics (energy) and it grew out to be one of the most celebrated tools in the 
study of dynamical systems cf. [10, 81, 89]. 

Concurrently, after proving Poincaré’s “last geometric theorem” in 1913 [11], 
it was in particular Birkhoff who propelled the qualitative study of dynamical sys- 
tems [12]. This qualitative viewpoint brought the general notion of stability more to 
the forefront, not only stability of a system, but also the stability of its description, 
called structural stability. Structural stability for 2-dimensional systems was intro- 
duced by Andronov and Pontryagin [2] and extended to 2-dimensional manifolds by 
Peixoto [116]. Smale is largely responsible for further abstractions and continuation 
of this line of work [139]. In particular, his creation of the horseshoe-map clari- 
fied what Poincaré was having trouble with in his work on the three-body problem: 
the intricate dynamics close to a homoclinic equilibrium point. Interestingly, Smale 


3 With Hermite, Mittag-Leffler and Weierstrass in the jury. 
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also made a significant contribution to another, yet topological, open problem by 
Poincaré, he proved the (generalized) Poincaré conjecture* forn > 5 [138]. 

In passing, we highlight a few other influential works, contributing to (the 
early development of) the qualitative theory of dynamical systems. The work by 
Hadamard [53, 54]—who was, interestingly, in close contact with Brouwer, Lef- 
schetz [95], LaSalle (La Salle) [91] and Hartman [55]. Early contributions to stability 
theory by Hermite, Routh and Hurwitz, e.g., see [69, 77]. The initial work on center- 
manifold theory by Pliss [117] and Kelly [80]. Catastrophe theory by Thom [150]. 
Converse Lyapunov theorems and its topological ramifications due to Kurzweil [87], 
Bhatia and Szeg6 [10] and Wilson [159, 160]. The concept of a region of attraction 
due to Aizermann, BarbaSin, Krasovskii, Nemyckii and Stepanov, e.g., see [10, 86]. 
The work by Kolmogorov, Arnol’d and Moser, e.g., see [24]. The work by Hirsch et 
al. [63]. The topological critical-point theory by Morse [107] and the work on chaos 
theory by Takens and Ruelle [132]. 

For more information, see [34, 48, 62, 65], or the historical notes in [1, 10, 50]. In 
particular, see [5] for an exposition of the competition organized by Mittag-Leffler, 
the initial error in the work submitted by Poincaré, how this was resolved and how 
the mathematical community responded. For more on the history of stability, see [77, 
96]. See [125], for the English translation of [118]. 


1.2.3. Modern Control Theory 


In the late 1700s, the field of control theory emerged due to a growing practical 
interest in improving the performance of mechanical systems. As discussed above, 
the 1800s gave rise to a lot of theoretical work on describing the dynamics of a sys- 
tem and in particular studying its stability. Nevertheless, motivated by the needs of 
war and after original work on telecommunication, filtering and circuit design in the 
frequency-domain, modern control theory, however, was only born in the mid 1900s 
out of the pioneering work by Kalman? [78, 79], Bellman [6], Pontryagin [47, 127] 
and their coworkers. This line of work emphasized some benefits of the state space 
approach (the time-domain) and essentially reconnected control theory to the early 
work of Poincaré and Lyapunov. The state space approach to linear control theory 
also brought linear algebra more to the forefront, which opened the door for a rigorous 
approach to nonlinear control, not merely by approximation, but also by appealing to 
differential geometric tools, cf. [21, 70, 110, 161]. Perhaps the central topic of study 
in (deterministic) control theory in the late 1900s was that of controllability, i.e., all 
questions related to the possibility of steering a system “from A to B”. Naturally, 


4 This conjecture states (in the category of topological manifolds): every closed n-dimensional 
manifold homotopy equivalent to S” is homeomorphic to S”. This conjecture was partially open 
until 2003, when Perelman filled in the gap for n = 3, see [144] for more on this program. 

5 Lefschetz came out of retirement in the late 1950s to start a group in Baltimore on nonlinear 
differential equations and no other than Kalman started his professional career in this group. 
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these questions relate to the aforementioned work on dynamical systems, e.g., if a 
space does not admit a dynamical system with a certain property, then clearly no 
input exists that can enforce it. Building upon the work of Chow® in 1940 [33], 
it can be argued that work on nonlinear controllability started in the 1960s—just 
after Kalman published his work on linear controllability—with influential contri- 
butions by Hermann [58], Lobry [100, 101], Haynes and Hermes [57], Sussmann 
and Jurdjevic [147], Brockett [20] and most notably Hermann and Krener [59]. 

In 1978, Jurdjevic and Quinn constructed a controllable system on R? that cannot 
be stabilized via differentiable feedback [75]. Then, against to what was a common 
belief at the time, by constructing an example on R?, Sussmann showed in 1979 that 
controllability does, however, also not implies that a stabilizing continuous feedback 
exists [146]. A year later, Sontag and Sussmann developed theory underpinning 
scalar examples along these lines [140]. These examples were not unparalleled as 
in 1983 Brockett gave an explicit necessary (topological) condition for stabilizing 
differentiable feedback laws to exist [23]. Brockett’s condition gave rise to many 
examples, as a lot of controllable systems failed to adhere to this condition. This, 
and earlier work by Kurzweil [87], Wilson [160] and Bhatia and Szeg6 [10] can be 
seen as a Start of the work on topological obstructions to stability and stabilization. 

For more on the development of nonlinear controllability and related tools see [32, 
71, 98, 153]. For more on the history of control theory, see [13] and for a historical 
account by Brockett himself, see [19]. See also [22, 60] for early works by Brock- 
ett and Hermann & Martin, respectively, highlighting the use of a topological and 
geometrical viewpoint in the context of system and control theory. 

At last, we emphasize two additional schools. First, in the East, Krasnosel’skii and 
coworkers elaborated during the second half of the 20th century on a blend of most 
of the aforementioned material in their study of topological methods in nonlinear 
analysis [84, 85]. As will be discussed below, the monograph by Krasnosel’skii 
and Zabreiko contains a variety of results related to arguably the most influential 
control-theoretic topological result produced in the West—known as “Brockett’s 
condition”, as discussed in detail in Chap.6 cf. [84, Chaps. 7-8], [23]. As also 
pointed out in [113], although the translated version of their monograph appeared 
in 1984, the original Russian version appeared in 1975, well before that particular 
work by Brockett. Moreover, Krasnosel’skii’s earlier monograph from 1968 [85] 
and a 1974 paper by Bobylev and Krasnosel’skii [15] contain work instrumental 
to [84, Chaps. 7-8]. See [103] for more on the work of Krasnosel’skii and [163] for 
an historical account by Zabreiko. Secondly, Conley and coworkers developed their 
generalization of Morse- and Lyapunov theory in the late 1970s [35, 36], a topic we 
will only briefly touch on as it has been covered before. 

What these works have in common is that they look for (algebraic) topologi- 
cal invariants that capture certain qualitative properties of spaces, maps, dynamical 
systems, and so forth. This viewpoint is at the core of this work. 


6 Although Rashevskii published similar work slightly earlier [128]. 
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Summarizing, the study into dimension and equivalences resulted in the devel- 
opment of a host of topological tools. Building on these tools and in part due to 
the inherent difficulty of solving differential equations brought about the qualitative 
theory of dynamical systems and control. 

This brief historical overview leaves us in the 1980s. The upcoming chapters will 
discuss how the control-, topology- and dynamical systems communities responded 
over the last 40 years and what can be learned from that body of work. 


1.3 Case Study: Optimal Control on Lie Groups 


To illustrate the developments we consider a problem simple enough to do explicit 
computations, but rich enough to be of importance. Specifically, we work with Lie 
groups, objects ubiquitous in engineering and physics [3, 14, 28, 109, 135]. 

A pair (G, -), with G a set and - a binary operation, is a Lie group when 


(i) the set G is a group under ., that is, g -h € G for all g, h € G, there is an 
identity element e € G such that e - g = g-e =e for any g € G, for all g € G 
there is an inverse element g7! € G such that g- g7! = g7! - g = e and the - 
operation is associative; 

(ii) the set G is a smooth manifold (informally, a set that is locally Euclidean and 
possesses a structure to make sense of derivations, see Chap. 2-3 for the details) 
and both multiplication and inversion are smooth maps. 


When it clear from the context, the operator - is dropped, i.e., one writes gh instead 
of g - h. For example, a Lie group of importance is the special orthogonal group 
SO(n, R) = {A € R”*” : ATA = I, det(A) = 1}. Here the group operation - is 
matrix multiplication and for any Q € SO(n, R), the corresponding inverse element 
is QT with the identity element being e = 1, for I, the identity matrix in R”*”. 

To every Lie group G corresponds a Lie algebra, denoted g, being a vector space 
identified with the tangent space of G at e (a vector space to be made precise in 
Chap. 3), denoted g = TG. For example, so(n, R) = T, SO(n, R) = {X e R” : 
XT + X = 0}. Lie algebras are powerful for us in that they parametrize the tangent 
space of G at any g € G. To see this, pick any differentiable curve t > y(t) € G 
such that y (0) = e. As we work with an abstract binary operator on G, it is convenient 
to define the left-translation map L, by h +> L.(h) = gh for any g, h € G. Now, 
define the curve t > c(t) = Le(y(t)) € G. Then, as c(0) = g, the derivative of c 
with respect to ¢ satisfies ¢(t)|<0 = DL g(h)|naeY (t)l:=0 € T,G such that we have 
the (tangent space) isomorphism D(L.)e- : TeG > T,G for all g € G. 

Now, let G be a compact connected Lie group and let (-, -) denote an Ad-invariant 
inner-product on g (the adjective “Ad-invariant’ can be ignored if unrecognized), 
which always exists as G is compact [82, Proposition 4.24]. A vector field X on G is 
said to be left-invariant when D(L,).X (e) = X (g) € T,G forall g € G, differently 
put, the evaluation of the vector field at e € G, defines the vector field on all of G. 
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(ii) 


Fig. 1.3 Section 1.3 (i) curves and tangent spaces on the Lie group G; (ii) a vector field X € Lie(S!) 


The set of left-invariant vector fields is denoted by Lie(G) and is isomorphic to g. 
For a visualization of the aforementioned concepts, see Fig. 1.3. 
Consider for a set {Xo, ..., Xm} C Lie(G) the input-affine control system on G 


d m 
ae = Xo (g)) + Xi (gO) ui, (l.la) 


i= 


with span{X,,..., Xm} = Lie(G) and the input vector u € R”. As such, (1.1a) 
is controllable for controls t +> u(t) € R” that are locally bounded and measur- 
able [76, Theorem 7.1] (informally, one speaks of controllability of (1.1a) when for 
any go, gı € G, there is a T > 0 and a map w: [0, T] > R” such that a solution 
gy : (0, T] x G > Gto(1.1a) under u satisfies (0, go) = go and g(T, go) = 81, for 
the precise definition see Chap. 5). Under these assumptions, one can study without 
loss of generality, the left-invariant control system 


d 
qo) = D(Lgay)e(u(t)), (1.1b) 


where u(t) = peer E;;(t) and span{E\,..., Em} = g. Then, given a discount 
factor 6 > 0, and with abuse of notation the exponential function e~*' define the 
infinite-horizon optimal control problem 


(oe) 


minimize J e” (d(e, g0)? + (u(t), u(t))) dt 
ae 


J (1.2) 


subject to (1.1b), g(0) = go, 


where the distance function d(e, g)? = (log(g), log(g)) between e and any g € G 
is defined with the aim of finding a feedback via (1.2) that stabilizes e in some 
sense. This construction is intended to generalize Linear-quadratic regulation (LQR) 
to nonlinear- systems and spaces, cf. [7, 8]. Note that log : G — g is only well- 
defined over the subset of G where exp : g > G is injective. Now, one can show 
that by construction of (1.2), one can appeal to Hamilton—Jacobi-Bellman (HIB) 
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theory which provides necessary optimality conditions for (1.2), e.g., see [18, The- 
orem 10.2]. Then, it can be shown that the optimal controller in (1.2) is given 
by u*(g(t)) = —plog(g(t)) for p > 0 satisfying —Bp — p? + 1 = 0, under the 
assumption that the controlled trajectory does not pass through the singularity of 
exp : g — Q, see [52, Theorem 4]. In fact, as u* (e) = 0, under the aforementioned 
assumption, the feedback u* renders e (locally) asymptotically stable [52, Theorem 
5]. 

On the basis of this example we will further illustrate various concepts, including, 
but not limited to: (i) the relation, or lack thereof, between controllability and the 
existence of continuous feedback; (ii) the source and (in)surmountability of discon- 
tinuous controllers; and (iii) the relation between the shape of the attractor and the 
domain of the dynamical system. 


1.4 Content and Structure 


This work surveys the inception, development and future of topological obstructions 
in the context of dynamical control systems. The aim is to present a unified and 
general treatment. As such, highly specialized results, as are known for surfaces, do 
not belong to the core of this work. Also, we largely focus on manifolds but indicate 
when results hold for more general topological spaces. Besides providing a review, 
a secondary goal of this work is to function as an invitation to the non-specialist. 

In the past, a small number of reviews appeared, for example, on low dimensional 
systems by Dayawansa [39]. Close to us is the work by Sanchez-Gabites [133] and 
Sanjurjo [134], albeit mostly focused on shape and Conley theory. The work by 
Byrnes [30] and later by Kvalheim and Koditschek [88] also contain overviews, but 
mostly focused on generalizations of Brockett’s condition. Topological obstructions 
are also briefly discussed in for example [141, Sect. 6], [19, Sect. 8], the monograph 
by Coron [37, Part 3], the monograph by Sontag [142, Sect.5.9], the monograph by 
Zabezyk [162, Sect. 7.6] and the extensive survey by Vakhrameev [153] on the devel- 
opment of geometric methods in the study of controllability and optimal control. See 
also the introductions to [38, 108] and the voluminous work by Jonckheere [73] 
on algebraic topology and robust control. At last we highlight the thesis by May- 
hew [104], containing hybrid- obstructions and solutions. 

Regarding the exposition, we follow the philosophy as set forth in [51] and provide 
mostly arguments from differential topology with the aim of having an audience as 
large as possible that can follow and appreciate the complete development. Wherever 
insightful we do indicate how results can also be shown using arguments from alge- 
braic topology. To further help the reader we provide ample examples, illustrations 
and references. Most of the results presented in this survey are already published 
and we systematically add a reference to which the reader can refer for more details. 
Some new results are added to complete those published and in this case we add a 
complete proof. Known proofs are occasionally presented to precisely show where 
assumptions are used and how to possibly relax them. 
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Although we will impose a smooth structure on our objects we stay in the topo- 
logical realm and rarely assume knowledge of a metric on our spaces. The price to 
pay for this generality is that few things can be quantified. 

We start by introducing a substantial amount of preliminary concepts from topol- 
ogy, dynamical systems and control theory. The benefit being that the core of this 
work can be described without technical clutter and in a somewhat self-contained 
manner. After presenting the topological obstructions, we also highlight how one 
might deal with these obstructions and what is considered future work. In particular, 
Chap. 2 introduces notions from general topology, e.g., homotopies and retraction 
theory whereas Chap. 3 introduces the prerequisite machinery for the Poincaré—Hopf 
theorem and the Bobylev—Krasnosel’skii index theorem, that is, notions from dif- 
ferential topology like transversality, tubular neighbourhoods and index theory are 
discussed in detail. Then, Chap. 4 briefly presents material from algebraic topology 
and states how the Euler characteristic can be seen through different lenses, e.g., 
via self-intersections, combinatorially, or via homology theory. Chapter 5 introduces 
notions from dynamical systems theory like flows, vector fields and Lyapunov sta- 
bility. Moreover, the dynamical control systems under consideration are defined. 
Chapter 6-—the core of this work—is devoted to discussing topological obstructions 
to stability and stabilization. First, for equilibrium points, then for submanifolds 
and subsequently for generic sets. In particular, this section aims to show that just 
a few viewpoints allow for generalizing a wealth of results. Chapter 7 presents an 
overview of how to work with these obstructions, e.g., by allowing for singularities, 
time-dependent feedback or by employing techniques from hybrid control theory. 
Elaborating on some of the aforementioned tools, Chap. 8 offers a few generalizations 
and concludes with a list of future work. 

Notation: We largely follow standard textbook notation, e.g., [51, 92, 142], but 
we state already that p € M” denotes an element of a n-dimensional manifold M” 
with the variable x being reserved for the state of a dynamical system. The symbols 
f and F are reserved to describe those dynamical systems, whereas g and G are used 
for general maps. When working with differential equations we use dé(t)/dt, &(t) 
or simply £ to denote the “time”-derivative. Also, F, will denote the pushforward of 
a map, whereas G, denotes the induced homomorphism between groups. Any subtle 
difference in notation will always be accompanied by clarifying text. 
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Chapter 2 A) 
General Topology get 


2.1 Topological Spaces 


If a set X and a collection of its subsets t satisfy the following three properties (i) 
t contains X and the empty set Ø; (ii) t is closed under finite intersections; (iii) t 
is closed under arbitrary unions; then, the pair (X, t) is called a topological space. 
The elements of t are said to be open and their complements in X are said to be 
closed. We assume all our topological spaces (X, t) to be Hausdorff, that is, for 
any two points pı, p2 € X there exist open neighbourhoods U1, U2 € t of pı and 
p2, respectively, such that U; N U2 = Ø. In what follows we frequently drop the 
explicit declaration of the topology t. A point p € X is called a limit of the sequence 
{px}e>o if for any open neighbourhood U of p there is a K € N such that py € U 
for all k > K. As X is a Hausdorff space, this limit is unique, which is important 
in the context of defining dynamical systems and their stability. Moreover, as we 
will appeal to Whitney’s approximation theorems, we assume all our topological 
spaces (X, t) to be second countable, that is, there is a set A C t such that every 
element in t can be written as a union of countably many elements in J%, i.e., T 
admits a countable basis. Then, we call the topological space (X, t) a n-dimensional 
topological manifold, when for each p € X there is an open neighbourhood U € t 
of p such that U is homeomorphic to R” (or equivalently, some open set of R”), that 
is, there is a continuous bijection between U and R” with the inverse of this map 
also being continuous (see below). When these homeomorphisms fail to exist, but 
do exist when elements of t are also allowed to be homeomorphic to open subsets 
of H” = {p € R” : p, = 0}, X is said to be a manifold with boundary, frequently 
denoted as dX 4 Ø. Indeed, d(0X) = Ø. 


Example 2.1 (The standard topology on R") Let ||- || be a norm on R” and let 
B” (p) = {y € R” : ||p — yl] < r} be an open ball in R”. The collection of all these 
open balls gives rise to a topology on R”, called the norm topology, or the standard 
topology, denoted Tsa. Now it can be shown that the set of all open balls B? (p), 
with a rational radius r, centred at a point p with rational coordinates, is a countable 
basis for the standard topology [4, Chap. IV]. As any two points pı, p2 € R” admit 
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(i) (ii) (iii) 


Fig. 2.1 Example 2.2, for the subspace- (i), quotient- (ii) and the standard topology (iii) on S!, 
we show a typical open set U’. When applicable, U denotes the corresponding open set in the 
topological space the topology on S! is inherited from 


open non-intersecting neighbourhoods B”? (p1), BY (p2) € tsa for r = $l Pi — poll, 
it readily follows that (R”, Tsa) is Hausdorff and second-countable. As any open ball 
is homeomorphic to R”, e.g., consider without loss of generality B} (0) and see that 
the homeomorphism ¢ : B} (0) —> R” is given by ọ : p> p/(1 — ||p|l) with the 
inverse map gy! : y œ> y/(1 + ||yll), it follows that (R”, Tsa) is in fact a topological 
manifold. 


Example 2.2 (Topologies on the circle S!) When looking at the circle as a subset 
of the plane, i.e., S! = {x € R? : ||x|]2 = 1}, one can define a topology on S! via a 
topology on R?. Generally, let (X, t) be a topological space and let A C X, then ta = 
{ANU : U ert} is the subspace topology on A. The circle can also be described 
as S! = R/Z or S! = [0, 1]/ ~ for 0 ~ 1, that is, one identifies all integers. Now 
again, the topology on R can be used to generate a topology on R/Z. Generally, 
let ~ be an equivalence relation on the topological space (X, t) and define the 
surjective map q : X > X/ ~, then, the quotient topology on X/ ~ is defined as 
tj~ = {U C X/ ~: q7!(U) € t}. A third option would be to directly employ open 
sets of the form {e}? : 6 € (a, b) C [0, 27]} C Cand proceed as in Example 2.1. See 
Fig. 2.1 for a visualization of these topologies. 


A function f : R > Ris said to be continuous atx € R when for each € > 0 there 
is ô > 0 such that for all y € R satisfying |x — y| < 6 one has | f(x) — f@)| < e. 
Some refer to this construction as the € — ô definition of continuity. Imposing a 
topology on spaces X and Y allows for generalizing the notion of continuity beyond 
Euclidean spaces. Let (X, r) and (Y, t’) be topological spaces, then f : X > Y is 
said to be continuous when for each V € t’ the preimage under f is a contained 
in t, i.e., f-'(V) = {p € X : f(p) € V} € t. Indeed, under the standard topology 
on R, one recovers the € — ô definition. Another concept of importance is that of 
compactness. An open cover of a topological space (X, t) is a collection of open 
sets V = {Uj} je7 with U; C X for all j € J, such that X = Uje7U;. Then, if a 
subset of Y still covers X, this subset is said to be a subcover. Now a topological 
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space X is compact when every open cover of X has a finite subcover. The notion of 
compactness is fundamental in topology since for any continuous map f : X > Y 
between topological spaces X and Y, when X is compact, so is f(X) [9, Theo- 
rem 4.32]. A useful result is the Heine-Borel theorem, stating that a subset of R” 
is compact if and only if it is closed and bounded [9, Theorem 4.40]. One should 
observe that continuity and compactness can be in conflict, i.e., a fine topology is 
desirable from a continuity point of view, yet a coarse topology is easier to work 
with when it comes to compactness. 

Regarding notation, we will drop the explicit dependency on t as the upcom- 
ing material is invariant under the particular choice of the topology, as long as the 
topology satisfies the properties as highlighted above. Besides, the dimension (of the 
component(s) under consideration) is frequently added by means of a superscript, i.e., 
X” denotes a n-dimensional topological manifold. Unless stated otherwise, n will 
be finite. As mentioned above, maps of interest are homeomorphisms, i.e., continu- 
ous bijections with a continuous inverse. When two objects are homeomorphic, we 
speak of topological equivalence, denoted ~;. Here, mapping the interval [0, 1) to 
the circle S! is the prototypical example of a map that is continuous and one-to-one, 
yet not a homeomorphism as the inverse cannot be chosen to be continuous. 


2.2 Homotopy and Retractions 


It turns out that many topological invariants (under homeomorphims) are invariant 
under a weaker notion; that of homotopy.' Let X and Y be topological spaces with 
gi and go continuous maps from X to Y. A continuous map H : [0, 1] x X > Y is 
said to be a homotopy from g; to g2 when for all p € X we have H(0, p) = gi(p) 
and H(1, p) = g2(p). If such a map exists, g; and g are homotopic, which is an 
equivalence relation, denoted gi~ng2. Moreover, if H is stationary with respect 
to some set A C X, that is, H(t, p) = gi(p) = g2(p) for all p € A and ż € [0, 1], 
then, H is a homotopy relative to A. We note that not only homotopies give rise to 
an equivalence class, but also homotopies relative to some subset [14, p. 24]. Two 
topological spaces X and Y are called homotopy equivalent, or simply homotopic, 
when there are continuous maps g, : X > Y, go : Y > Xsuchthat gı o g2~,idy and 
gı © go~pidx, e.g., generalizing the concept of a homeomorphism to maps that are 
not necessarily invertible. It is imperative to remark that when colloquially referring 
to “the topology of a space X” one commonly refers to the homotopy type of X. 


Definition 2.1 (Retractions) Given a topological space X, a subset A C X is a 
retract of X if there is a continuous map r : X — A, called a retraction, such that 
rot, = ida, fort, : A > X the inclusion map. The retraction is said to be a defor- 
mation retract when 14 o rXpidx. We speak of a strong deformation retract when 
the homotopy is relative to A. On the other hand, A is weak deformation retract of 
X if every open neighbourhood U C X of A contains a strong deformation retract V 
of X such that A C V. 


' One can argue that homotopy theory is a field of its own and not merely a branch of topology [1]. 
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Fig. 2.2 Definition 2.1, (i) a deformation retract of X onto the point A; (ii) a strong deformation 
retract of X onto the point A; (iii) a weak deformation retract of X onto the set A, with A being 
the boundary of the cube without the point a, U an open neighbourhood of A and V C U a strong 
deformation retract of X 


A deformation retraction maps all of X, continuously, to A, but with A free to 
move throughout the process. On the other hand, a strong deformation retract keeps 
A Stationary, see also Fig. 2.2. A mere retraction to a point is not particularly inter- 
esting as one can retract to any point via the constant map. As will be clarified below, 
deformation retracts, however, relate to stability notions indeed. For more on retrac- 
tion theory, see [2, 7], it is imperative to remark that the literature does not agree on 
the terminology used in Definition 2.1 cf. [5]. 


Lemma 2.1 (Subset deformation retract) Let both A and B be deformation retracts 
of C. Then, if A C B, A is a deformation retract of B. 


Proof As C deformation retracts on A C C there is a map ra : C > A such that 
ra otac = id4, tac o raœnidc for tac : A > C. Similarly for B C C, there is a 
map rg : C —> B such that rg o tgc = idg, tgc o rgB%œnpidc. Now construct the map 
r : B — A via the inclusion map tgc : B > C, that is, r = r4 o tgc. As A C B, 
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we have that r o t4g =r4o0ltgc otag =a olac = ida. Moreover, as tgc olap oO 
rapidc and rg olgc = idg we have that 14g o r&pidp, as desired. 


For more on the relation between homotopies and deformation retractions, see, [7], 
[14, Chap. 1], [5, Chap. 0] or [10, Chap. 7]. 

When for a closed subset A C X there is an open neighbourhood U € X of A 
such that A is any retraction type from Definition 2.1 of U, then A is said to be a 
neighbourhood retract, of that particular type, e.g., a neighbourhood deformation 
retract, reconsider Fig. 2.2(iii). 


Lemma 2.2 (Neighbourhood retracts [12, Theorem 4]) Let A C X be a weak 
deformation retract of B C X, then the following hold: 


(i) if A is a neighbourhood retract of X, then A is a retract of B; 
(ii) if A is a neighbourhood deformation retract of X, then A is a deformation 
retract of B; 
(iii) if A is a strong neighbourhood deformation retract of X, then A is a strong 
deformation retract of B. 


The intuition behind Lemma 2.2 is that B strongly deformation retracts onto a neig- 
bourhood of A, which can be subsequently retracted to A itself. 

The prototypical retraction example is that of the sphere S”~! being a strong 
deformation retract of the punctured Euclidean space R” \ {0}. To see this, consider 
r(p) = p/||pll2 and let the homotopy, relative to S’~!, be the convex combination of 
r and idg», that is, H(t, p) = tr(p) + (1 — t)p. See Example 3.1 for a retraction in 
the context of vector bundles, Example 5.3 for a homotopy in the context of Lyapunov 
functions and Example 6.10 for strong deformation retracts of Lie groups. 

A set S is contractible when idg is homotopic to a constant map. Equivalently, 
S is homotopy equivalent to a point or a point p € S is a deformation retract of 
S. For example, X in Fig. 2.2(i) is contractible, while X in Fig. 2.2(iii) is not. Note, 
contractability does not imply that the deformation is strong [5, Exercise 0.6]. 


Remark 2.1 (On contractible sets) One might expect that all n-dimensional con- 
tractible sets are homeomorphic to R”. In 1935, Whitehead provided the first coun- 
terexample. Namely, there is an open, 3-dimensional manifold which is contractible 
but not homeomorphic to R?, see [15]. Although we focus on the finite-dimensional 
setting, more counter-intuitive phenomena appear in the infinite-dimensional setting. 
For example, S% is contractible [5, Example 1B.3]. 


2.3 Comments on Triangulation 


Motivated by Morse [3, p. 913], triangulations were formally introduced by Cairns, 
with further initial work by Brouwer, Freudenthal and Whitehead [8, Chap. 15]. A 
topological space X is called triangulable when the space is homeomorphic to some 
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Fig. 2.3 Adding the lines 
£1, €2 and £3 preserves the 
Euler characteristic 


polyhedron P. Then, the Euler characteristic for surfaces of polyhedra is given by 
x(P) = V — E + F, for V the number of vertices (0-dimensional), € the number of 
edges (1-dimensional) and F the number of faces” (2-dimensional) of the polyhedron 
P at hand. It turns out that this number x (P) equals 2 — 2g, for g the number of 
holes in P and is independent of how one selects the triangulation, as such, x is a 
topological invariant of X, see Fig. 2.3. This invariance is why in what follows one 
will keep seeing alternating sums akin to x (P). Studying a topological space X via a 
naive triangulation, however, requires attention above dimension 3, those topological 
spaces do not have a canonical triangulation e.g., see [13], [9, Chap. 5] for more on 
the so-called Hauptvermuntung. 

For further references on general topology, see [5, 7, 9, 14] and see [11] for how 
homotopies appeared in the context of robust control, albeit not explicitly. 
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Chapter 3 A) 
Differential Topology geai 


3.1 Differentiable Structures 


To make sense of differentiation on a topological manifold, we need to provide 
additional structure. A pair (U, œ) with U open in M” and g a homeomorphism 
from U to some open subset of R” is called a chart. Then, for any p € U, (p) = 
(x! (p), ..., x” (p)) € R” are said to be local coordinates of p on U , with the inverse 
map sometimes called a parametrization. A pair of charts (U1, o1) and (U2, 2) is C’- 
compatible when either U; N U2 = Ø or g2 o or! : @(U; N U2) > g2 (U1 N U2) is 
C’-smooth. A collection of charts {(U;, gi)}iez such that M = U;jez U; and all charts 
are C’-compatible is called a C’-smooth atlas. Now we can define a C’-smooth 
maximal atlas, denoted A , as the atlas that contains all charts C’-compatible with 
the elements of ./. Then, we say that M is a C’-smooth manifold, or simply a C” 
manifold, when M admits a C’-smooth maximal atlas o/ = {(U;, ;) }iex for some 
r € NU {oo} U {œ}. As such, one can call a topological manifold a C° manifold. 
See [27, Example 1.4, Example 1.31] for the construction of a smooth structure 
on S"~!. It is imperative, however, to point out that one rarely constructs atlases 
explicitly, their mere existence usually suffices. We speak of smooth manifolds when 
r > 1. There is no need to further classify these spaces as forr > 1, every C” manifold 
is C” diffeomorphic to a C% manifold [18, Theorem 2.2.10]. 

Given a smooth manifold M”, then T,M” denotes the tangent space of M” at the 
point p € M”, that is, T7,M” = {y(t)|;=0 : t œ> y (t) € Mis a curve differentiable at 
0 with y (0) = p}. Now by considering equivalence classes of curves, with respect 
to y(t);=0 in coordinates, one can show that T,M™ has a m-dimensional vector 
space structure [27, Chap. 3]. The disjoint union TM” = U pem» T,M" is the tangent 
bundle of M” and is a smooth 2m-dimensional manifold itself [27, Proposition 3.18]. 


3.2 Submanifolds and Transversality 


Given two smooth manifolds M” and N” with m > n, let G : M” — N” be a smooth 
map, then, q = G(p) € N” is a regular value if the differential of G at p, DG, : 
T M” — Tep N”, is surjective for all p such that G(p) = q. The points p € M” 
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where this surjectivity condition fails are called critical points of G on M”. Now 
it follows from Sard’s theorem that regular values are generic! [27, Theorem 6.10]. 
Similarly, one can define regular points and critical values. The critical points of a 
smooth function g : M — R are all points p € M such that Dg, = 0. 

Again, let M and N be smooth manifolds and let G : M — N be a smooth map. 
The map G is called a smooth submersion when DG, is surjective for all p € M. 
Similarly, G is a smooth immersion when DG, is injective for all p € M. The 
map G is called a smooth embedding when G is an immersion and M is homeo- 
morphic to its image G(M). Let the subset S C M be a manifold under the sub- 
space topology, then, S is said to be an embedded submanifold when the inclusion 
tg : S — M is a smooth embedding. When irrelevant or unknown, the adjective 
“embedded” is omitted, the same is true for the declaration of a particular map 
ig, the mere existence of some embedding usually suffices, i.e., we simply write 
SoM. 

Similar to the kernel of a linear map, the preimage of a regular value, under a 
smooth map G : M” — N”, is a submanifold of dimension m — n, e.g., think of 
S”—!, The generalization beyond points (regular values) turns out to be remarkably 
useful. 

Let G : M” — N” be a smooth map between smooth, boundaryless, manifolds 
and let S* C N” be some smooth, boundaryless, submanifold. Then, G is said to be 
transverse to S5, denoted G rh S*, when either G(M”) N S! = Ø or 


im(DG,) + Top) S = Teip N” (3.1) 


for all p € G7! (S°), see Fig.3.1G). Evidently but importantly, (3.1) trivially holds 
for G being a smooth submersion. When the transversality conditions holds, then by 
the implicit function theorem, the preimage of S', that is G7! (S5), is also a subman- 
ifold, of dimension m — n + s [16, p. 28]. Two submanifolds S; C N and S} CN 
are called transverse when the inclusion map of one of them is transverse to the 
remaining submanifold. This boils down to the condition that T,S1 +T} S, = TN 
for all q € Sı N So, which has a clear geometric interpretation. A particularly use- 
ful implication is that when S; mh S2, then S; Sz is a submanifold itself, with 
codim(S; N S2) = codim(S;) + codim(S2) [16, p. 30]. 

Generalizing transversality to maps over domains with a boundary, i.e., OM 4 Ø, 
requires the restriction G|əm : OM — N to be also transverse to S for G7! (S) to be 
a manifold with boundary that satisfies 3{G7!(S)} = G71 (S) N OM, see [16, p. 60], 
consider for example an ellipsoid in a disk as in Fig. 3.1 (ii). 

Then, the power of transversality is captured by the following two results. 


Theorem 3.1 (Thom’s (parametric) transversality theorem [16, p. 68]) Let H : 
T x M > N be a smooth map over the manifolds T, M and N, with only M possibly 
having a boundary. Define the family of maps {G;, : t € T} by G;(p) = H(t, p) and 


' This means that the corresponding critical values are of measure zero in N [13, Chap. 2]. When 
the condition n < m is relaxed, one speaks of critical points when the rank of DG ņ is not maximal. 
Sard’s theorem is also a typical result aided by C’*! smoothness [29, Sect. 2]. 
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Fig. 3.1 Transversality, (i) G : M —> N with G rh S; (ii) € ý D? 


let S C N be a smooth submanifold. If H h S and H |aņm M S, then, for almost every 
t € T also G, ù S and G,;|am M S. 


Using the language of jets, one can show that transversality generalizes regular val- 
ues in the sense that transverse maps are also generic? [13, Theorem II.4.9, Corol- 
lary II.4.12]. Again, this corresponds to geometric intuition, drawing two lines at 
random in R?, they will be almost surely transverse. Technically, one can prove this 
by showing that for appropriate T, the map A is easily constructed to be a perturbation 
of G, yet, submersive, and hence transversal to any S. 


Theorem 3.2 (Transversality homotopy extension theorem [16, pp. 72—73]) Let 
S be a smooth submanifold of N, both without boundary, and consider a closed 
subset A C M of the smooth manifold M. Let G : M — N be a smooth map such that 
G h Son A and Gļ|am tS on AN OM. Then, there is a smooth map G': M —> N, 
homotopic to G such that G' h S, G’|ay A S and G = G' on a neighbourhood of 
A. 


By taking A = 0M, Theorem 3.2 implies in particular that if g : ƏM — N is trans- 
verse to S C N and g extends to M, then there is an extension G : M —> N such that 


GAS. 


3.3 Bundles 


Given two topological spaces E and B, the total and base space, respectively, and 
a continuous surjective map x : E — B, then, the triple (zr, E, B) is called a vector 
bundle when for each b € B the fiber 1~'(b) has the structure of a real vector 
space, say R*. Moreover, for any b € B, E must be locally trivial over some open 
neighbourhood U of b, that is, there is a homeomorphism g : 2~'(U) > U x R*. 
Additionally, g should preserve the base and fiber structure, i.e., for ty (U, R‘) =U, 
my og =x and for each b' € U, g(x! (b')) is linearly isomorphic to R*. Given 
a vector bundle x : E — B, a section is a continuous map o : B > E such that 


2 Meaning, with respect to the C° (Whitney) topology. 
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x oø = idg. Sections, denoted T (E), will aid in describing feedback laws later on. 
A section of interest is the zero section Zy € I (E), defined by mapping b € B to the 
zero element of the fiber 77! (b), i.e., Z,,(B)~,B, see also Fig. 3.2(i). 


Example 3.1 (Vector bundle retraction) Consider a vector bundle x : E > B, 
then Z,,(B) is a deformation retract of E. Conceptually, one retracts E along the 
fibers to B. To show this, we first need to establish how to transition between 
two homeomorphisms g : 7~!(U) > U x R* and Ww: 27!(V) > V x R* with 
U N V Æ Ø. It follows from the structure preservation that tyny 0 9 o YT! = tyny 
and as such for any b € U N V we have gow '!(b, x) = (b, g(b, x)) for some 
g : (UNV) x Rt — R*. By the properties of y, y, the map x +> g(b, x) must bea 
linear bijection, that is, g(b, x) = A(b)x for A(b) € GL(k, R). Evidently, this means 
that the transition g o y~! is linear in x € R*. Now, as we can let E be locally trivial 
over some neighbourhood U of b € B, construct, in local coordinates the homotopy 
H(t, (b, x)) = (t, (b, (1 — t)x)). As we just saw, the local transition maps are also 
linear in x, as such, this construction is well-defined over the entire vector bundle 
and indeed yields a deformation retract from E onto Z, (B). 


Example 3.1 also shows why vector bundles admit zero sections; the transition 
gow! maps 0 to 0. For more information, see [18, Chap. 4]. 

Then, to characterize neighbourhoods of embedded submanifolds, it is useful 
to introduce the following. The vector bundle zs : S > B is a subbundle of the 
vector bundle x : E — B when SCE, zg = z|g and for all b € B one has that 
tg (b) = S N x7! (b) is a linear subspace of the fiber m~! (b). A subbundle of par- 
ticular interest is the normal bundle of an embedded (or immersed) submanifold 
M” C R4, denoted TM+ or NM. This bundle is the orthogonal complement, under 
the Euclidean inner-product inherited from Rf, of the tangent bundle in the embed- 
ding space. In particular, let S C M be an embedded submanifold of a smooth man- 
ifold M. For simplicity assume M is itself embedded into Euclidean space. Then, the 
normal bundle T S+, with respect to TS, is given by TS+ = U,cgT,S+, for T,S+ the 
orthogonal complement, with respect to the Euclidean metric, to T,S. Algebraically, 
TS+ C TMis given by the quotient TM|s/7S [18, Chap. 4.2]. 

Now, following [27], consider some embedded submanifold M C R’ and define 
the map w: NM => R? by w(p,n) = p+n. Additionally, define the set V = 
{(p,n) € NM: ||n|| < 6(p)} for some continuous function 6 : M — Ryo such that 
V is open. Then, a neighbourhood U of M in R¢ that is diffeomorphic to w(V) is said 
to be a tubular neighbourhood of M. The Tubular neighbourhood theorem states 
that every embedded submanifold of R? has a tubular neighbourhood [27, Theorem 
6.24]. By exploiting the diffeomorphism w : V —> U, one can show the following, 
see also the €-neighbourhood theorem [16, p. 69] and Fig. 3.2(ii). 


Proposition 3.1 (Tubular neighbourhood retraction [27, Proposition 6.25]) If U is 
a tubular neighbourhood of some smooth embedded submanifold M C RY, there is 
a smooth map r : U —> M that is both a retraction and a submersion. 


Proposition 3.1 will be useful in a later stage, it also allows for showing the 
following well-known result by Whitney, here, G is understood to be 6-close to F. 
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Fig. 3.2 Bundles, (i) the vector bundle z : E > B with zero section Zy (B); (ii) a tubular neigh- 
bourhood U of S! c R? 


Theorem 3.3 (Whitney’s Approximation Theorem [27, Theorem 6.26]) Let M and 
N be smooth manifolds, with only M possibly having boundary. For any continuous 
map F : M —> N there is a smooth map G : M —> N homotopic to F. 


Indeed, G can even be chosen such that G rh S for any S —> N [27, Theorem 6.36]. 

In what follows we mostly study continuous maps on smooth manifolds. However, 
most of the results at our disposal require some degree of smoothness to be proven, 
not merely continuity. At the same time, most of these results are invariant under 
homotopy. As such, Theorem 3.3 allows from bridging the gap between continuity 
and smoothness, which would be otherwise non-trivial. See also [18, Lemma 5.1.5]. 

We end this section with a comment on a generalization of vector bundles. Instead 
of demanding that the fibers are vector spaces, one can relax this to the demand 
that 2~!(b) is homeomorphic to some topological space F, while E must still be 
locally trivial. In this case, the 4-tuple (x, E, B, F) represents what is called a fiber 
bundle, e.g., (7, S3, S?, S!) is arguably the most influential example and is called the 
Hopf fibration. Importantly, for fiber bundles the existence of a continuous section is 
not immediate. A section does exist when F is contractible [39, Part III]. We return to 
this topic in Chap. 6. Additionally, one can specify the structure group, e.g., instead 
of GL(k, R) in Example 3.1, one could consider O(k, R) and so forth. 


3.4 Intersection and Index Theory 


The practical classification of manifolds and maps over these manifolds relies on 
topological invariants (frequently, homotopy invariants). Using the previous results 
on transversality we provide a brief overview of the construction of the key topo- 
logical invariant for this work: the Euler characteristic. In this chapter this in done 
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through the lens of differential topology and in the next chapter we highlight argu- 
ments from algebraic topology. We point out that the material in this section is 
instrumental to appreciate later chapters and sections. 

Let M be a smooth compact manifold and let the smooth map G : M > N be trans- 
verse to the closed submanifold S C N. Suppose that dim(M) + dim(S) = dim(N) 
such that dim(G~!(S)) = 0, i.e., G7! (S) is a finite set of points. Let #(-) denote the 
number or points, then, define the mod 2 intersection number of the pair (G, S) as 


1,(G, S) = #(G~'(S)) mod 2 € Z/2Z. (3.2) 


For a general map, recall from Thom’s transversality theorem (Theorem 3.1) that 
transversality is generic such that for any G’ : M > N, we let 1(G’, S) = L(G, S) 
for any G homotopic to G’ that also satisfies the transversality condition G rh S. The 
following result shows why this is well-defined. 


Theorem 3.4 (Mod 2 intersection homotopy invariance [16, p. 78]) Let M” be com- 
pact and let S C N” be a closed submanifold such that m + s = n, all manifolds 
being boundaryless and smooth. Then, for any pair of smooth maps G1, G2 : M” > 
N” being homotopic, one has Ih(G,, S°) = In(G2, S°). 


As this result exemplifies upcoming material, a proof from [16] is collected. 


Proof By definition we have I,(G’, S°) = h(G, S*) such that GX, G’ and G h S*. 
Hence, by the transitive property of homotopies, without loss of generality, let G; h 
S* and G2 h S*. Then, let H : [0, 1] x M” — N” be the homotopy between G; and 
G2. By construction, H |ə{fo,1]xm} is transverse to S*. By the homotopy transversal- 
ity extension theorem (Theorem 3.2) we can assume that H rh S*,i.e., as the map can 
be extended. This implies that H—'(S*) is a one-dimensional manifold with bound- 
ary, defined via 0{H~'(S*)} = ({0} x G,'(S')) U ({1} x G;'(S*)). Then the result 
follows by observing that one-dimensional manifolds have boundaries with an even 
number of points, motivating the definition of J(+, -), see [29, Appendix]. 


For example, if we construct the constant map C : M” —> N”, for n > 0, defined 
by C:: pt q' forall p e M” and some q’ € N” \ S’, then the transversality condi- 
tion (3.1) holds trivially and indeed /,(C, S*) = 0. We point out that exactly results 
like Theorem 3.4 are the reason why we discussed (transversality in the context of) 
manifolds with boundaries, i.e., see that the manifolds under consideration in that 
theorem are all boundaryless themselves while in the proof we exploit [0, 1] x M”. 

Again, one can use the inclusion map to define the intersection number between 
manifolds. Let both S; C N and S, C N be compact and boundaryless, and of com- 
plementary dimension, that is dim(S,) + dim(S2) = dim(N). Then, (S1, S2) = 
Ih(ts,,S2), for ts,:S; oN. If Sı d Sz, then, by construction (8), S2) 
= #5) (S2)) mod 2, which is simply the number of intersection points, modulo 
2. Due to the homotopy invariance, when (S1, S2) = 1, any manifold homotopic 
to S4 intersects Sy, e.g., consider two circles on the torus. In that sense, 15(-, -) is 
robust. 


3.4 Intersection and Index Theory 35 


Lemma 3.1 (Compact manifolds are generally not contractible) Compact, bound- 
aryless manifolds N” with n > 1 are not contractible. 


Proof Suppose N” is contractible, then idy» is homotopic to some constant map 
C : q |> q' over N” for some q’ € N”. Then, given any compact M” and closed sub- 
manifold S* C N” such that m + s = n, pick any smooth map G : M” — N” trans- 
verse to S*. It follows by homotopy equivalence and composition that (G, S°) = 
h(idn: o G, S*) = h(C o G, S‘) = 0 (if needed, perturb S* not to contain q’). In 
particular, consider the setting of G being the identity map on N”, forcing S* to 
be a point, i.e., s € N” \ {q’}. One is led to a contradiction as N” N S° = {s}, yet, 
Ty(idy, S*) = 0. For a reference, see [16, Exercises 5-6, p. 83]. 


Manifolds of dimension 0 can be contractible and indeed, the proof fails for n = 0 
as in that case J (C o G, S*) is not necessarily 0. When dN” 4 Ø contractability 
might hold. In that case, the proof fails as the homotopy invariance of J) does not 
necessarily carries over, e.g., consider the unit interval moving through to the unit 
circle.? One can also employ Poincaré duality (see Sect. 4) to show Lemma 3.1. 

We introduce one more concept. Let G : M” —> N” be a smooth map from a 
compact to a connected manifold with m = n, both boundaryless.* Then, for any 
q € N”, the number 15(G, {q}) is the mod 2 degree of G, denoted deg,(G). Note 
that this number is a homotopy invariant by Theorem 3.4 and itis the same for any g € 
N” [16, p. 81]. This means that given a regular value q, deg, (G) = #(G~!(q)) mod 2. 

An obstruction related to Lemma 3.1 holds for deformation retracts. 


Lemma 3.2 (Compact manifolds admit no proper deformation retract) Let M be a 
boundaryless, compact, connected, manifold. Then, there is no proper subset A of 
M such that M deformation retracts onto A. 


Proof For the sake of contradiction, assume there would be such a deformation 
retract, let r : M — A be the retraction and let 14 : A —> M be the inclusion map. 
Now clearly, deg, (ta o r) = Oas one can consider the preimage of any point in M \ A. 
However, by assumption t4 o r©pidm, such that 0 = deg, (ta o r) = deg, (idm) Æ 0. 


For example, by Lemma 3.2, the group SO(3, R) cannot deformation retract onto 
SO(2, R) —> SO(3, R). Spot again the boundaryless assumption. 

Due to the binary evaluation, however, the insights gained from mod 2 intersection 
theory are limited. Endowing a space with an orientation allows for a different 
manipulation of #G~'(S) with far reaching ramifications. 

A smooth manifold M” is said to be oriented when an admissible smooth orien- 
tation is selected (see below). All orientations will be with respect to the standard 


3 We stay in the realm of topological manifolds, often assumed to be compact and without boundary. 
Relaxing these assumptions often requires the homotopy to be proper. A map G : X — Y is said 
to be proper when G~!(K) is compact for any compact K C Y. The intuition is that under this 
properness assumption, G7! (q) is a compact set indeed for any point q € Y, which is exploited in 
a variety of manners, e.g., when working with the degree. For more, see [33, Chap. MIJ. 


4 One can handle non-trivial boundaries for instance when G is proper and such that G : ƏM” —> 
ƏN”, or using axiomatic degree theory [33, Chap. IV], which we only briefly mention. 


36 3 Differential Topology 


polno) 0 


(i) (ii) 


Fig. 3.3 Oriented intersections, (i) orientation on a one-dimensional manifold with boundary; (ii) 
self-intersection number x (S!) = I (Agi, Agi) = 0 


orientation on R” . Given a vector space V”, if a basis B for V” is isomorphic to R” 
by means of an orientation-preserving map, that is, a linear map with strictly posi- 
tive determinant, then V” is said to be positively oriented under B. Otherwise, V” 
is negatively oriented. For manifolds with boundary, the orientation on the bound- 
ary is the one induced by the outward normal. For 1-dimensional manifolds with 
boundary, the domain of the local coordinates needs to be altered for this to work, 
that is, allow for mapping to R<o. Following [41, Example 21.8], given two charts 
(Uo, po) and (U1, 1) on [0, 1] defined by Up = [0, 1), go(x) = x and U; = (0, 1], 
g(x) = x — 1, observe that g; o Qo | =x — l and ø o 9)" = x + 1, as such, [0, 1] 
is orientable, that is, the transition functions preserve orientation. This does, how- 
ever, mean that the outward induced orientation assigns —1 to the point 0 and +1 to 
the point 1 as shown in Fig. 3.3(i). This example will also aid in illustrating why the 
(oriented) degree is defined for boundaryless manifolds below. 

It turns out that transversality naturally leads to an orientation on the manifold of 
interest. Let G : M —> N be smooth, with Sy C N, N and Sy boundaryless, G h Sn, 
Glam A Sy, and M, N, Sy all oriented. Let Sy = G~! (Sy) and define T} (Sm; M) to 
be complementary to TpSm, that is, (3.3a) below must be satisfied, e.g., T (Sm; M)is 
the orthogonal complement when a metric is defined (which is irrelevant for the pro- 
ceeding discussion). By combining transversality (3.1) with T, Sm being the preimage 
of Tcp) Sn under DG p, we obtain for all p € G7! (Sn) that 


T} (Sm; M) @ T,Sm = T,M (3.3a) 
DG,T} (Sm; M) © Top) Sn = TaN. (3.3b) 


Then, as by transversality, the kernel of DG, must be contained in TpSm (in the 
preimage of Tgp) Sn), (3.3b) induces an orientation on T3 (Sm; M) and subsequently, 
via (3.3a) an orientation on T, Sw, called the preimage-orientation. 

Now the oriented intersection number is defined similar as h, yet we add up 
orientation numbers, with respect to the preimage-orientation, of all p € G7! (S) = 
Sm, denoted 7(G,S). In particular, let G : M —> N be smooth and transverse to 
S CN. Under compactness of M, closedness of S and a complementary dimension 
condition, G~'(S) is a finite set of points. Now also assume that M, N and S are 
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oriented. As G rh S one has for any p € G~'(S) that DG ,T,M ® Teip) S = TaipN. 
It follows from (3.3) that the orientation number at p is defined and equals + 1 when 
the orientation on both sides of the equation agrees, whereas the orientation number 
is —1 when they do not. Note that 0-dimensional manifolds also have an orientation 
attached to them and that (3.3a) only implies that T (p; M) and T,M are isomorphic. 

Most importantly, oriented intersection numbers are also homotopy invariant [16, 
p. 108]. Indeed, this result is similar to Theorem 3.4 and to that end we clarified 
above how to define orientation on a boundary. More specifically, in the mod 2 
intersection setting, the proof of Theorem 3.4 relied on the sum of boundary points 
of one-dimensional manifolds, modulo 2, always being 0. Recalling Fig. 3.3, in the 
oriented case, the sum of the orientation numbers of exactly those points is also 
always 0. Given this homotopy invariance, we define the oriented intersection number 
of general smooth maps G” via Z(G’, S) = I (G, S) for a map G that does satisfy 
the aforementioned conditions and is homotopic to G’. Exploiting this observation 
regarding one-dimensional manifolds one can show the following. 


Lemma 3.3 (Intersection number extension lemma [16, p. 108]) Let g : dJM—>N 
be a smooth map transverse to a closed, smooth, boundaryless submanifold S c N 
of complementary dimension. If g extends to the entire smooth, compact manifold 
M, then I(g,S) = 0. 


Proof (sketch) Let G : M — N be the extension, by construction Gl|ay h S and 
by Theorem 3.2 one can take G rh S such that G~'(S) € M is a one-dimensional 
manifold. The result follows by recalling that by transversality a{G!(S)} = g!(S). 


Similar as before, for any smooth map between boundaryless manifolds G : 
M” —> N” with m = n, M” compact and N” being connected,” we define the degree 
of G as deg(G) = I (G, {q}) for any q € N” (recall Theorem 3.1). In this case the 
orientation number can be computed using the same reasoning as before, i.e., for 
p € G7! (q) we check if DG p Will preserve or reverse the orientation on T,M”. If 
M” is endowed with the canonical positive orientation, then, for any regular value q 


deg(G)= J. sgndet(DG,). (3.4) 
peG'(q) 


The form of (3.4) goes back to Kronecker and the intuition of (3.4) is that the 
number deg(G) represents how many times (net) the domain “wraps around” the 
codomain under the map G. See also Sect. 4 for the homological viewpoint. 
Example 3.2 (Homotopies and the n-sphere) Consider the n-sphere S” c R"*!, a 
smooth manifold X and a smooth map G : X —> S”. Now, let G’ : X —> S” be such 
that ||G(p) — G’(p)|l2 < 2 forall p € X. This condition implies that G is homotopic 
to G’ as H : [0, 1] x X > S” defined by 


Q — 1)G(p) — tG'(p) 


H ` = 
"P= Ta HG) — 16) 


5 Without the connectedness assumption the degree might differ from component to component. 
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is the corresponding homotopy. This construction concurrently shows the robustness 
of deg(-). Note, the || - ||2 condition is not necessary as on S! C R? one can rotate 
the identity map to its negation. In fact, Hopf’s degree theorem states that if M is 
compact, connected, boundaryless and oriented, then any continuous map g : M > 
S” is homotopic to g’ : M — S” if and only if deg(g) = deg(g’) [29, Sect. 7]. 


As before, given two submanifolds Sı and S2, we can also define 7 (S4, S2) 
via their respective inclusion maps. Note, however, that by no means J (Sj, S2) is 
necessarily equal to J (S2, Sı). In particular, one can show [16, pp. 113—115] that if 
S* and R” are compact submanifolds of N” of complementary dimension, then, 


1(S*, R”) = (1°77 (R", S°). (3.5) 


We can now define the central invariant of this work. Let Ay denote the diagonal 
of V x V, that is, Ay = {(v, v) : v € V}, and let M be a smooth, boundaryless, 
compact and orientable manifold, then, its Euler characteristic is defined as 


x(M) = I (Am, Am). (3.6) 


Note, (3.5) implies that x (M’”) = 0 when m is odd. One should interpret the self- 
intersection number (3.6) with the aforementioned transversality conditions and 
homotopy invariance taken into account. For example, for M = S!, think of Ag 
as a particular circle on S! x S! = T’. Then, x(S!) captures to what extent a homo- 
topy of Agi remains entangled with Ag, see Fig. 3.3(ii). See also Sect. 4.2 for x (M) 
through the lens of algebraic topology. We will follow a constructive approach in 
showing how x (M) relates to qualitative properties of vector fields on M. We do not 
start with vector fields, but with maps. This simplifies the analysis and in contrast to 
combinatorial/algebraic approaches, this makes it possible to relate some upcoming 
material to discrete-time systems via time-one maps cf. Section 8.1. 

Let G : M— M be a smooth map over a smooth, boundaryless, compact, ori- 
entable manifold M. The existence of fixed points of G is for instance captured 
by the Lefschetz number L(G) = I (Ayp, graph(G)) being different from 0. Indeed, 
L(idm) = x (M). A map G is called a Lefschetz map when graph(G) ù Aw, yielding 
robust fixed-point properties. Now, one can derive that G being Lefschetz over M” 
is equivalent to DG, — Im being invertible (the reader is invited to visualize this). 
Fixed points p € M” of G such that DG, — In is invertible are called Lefschetz fixed 
points and for Lefschetz maps one can compute L(G) via local Lefschetz numbers, 
that is L(G) = È p=G(p) Lp (G), where the sign of the corresponding isomorphism 
defines the local Lefschetz numbers, i.e., the orientation numbers of the Lefschetz 
fixed point. By comparing orientations, one can show the following. 


Proposition 3.2 (Lefschetz number of Lefschetz fixed point [16, p. 121]) Let 
G : M” — M” be a smooth Lefschetz map over a smooth, boundaryless compact, 
orientable manifold M", then 
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L(G)= }, sgndet(DG, — In). (3.7) 
p=G(p) 


Equation (3.7) is appealing, but only valid for Lefschetz fixed points. In the dynamical 
systems context, by only considering Lefschetz fixed points we are ignoring a set 
of structurally unstable fixed points. To make sure that L(G) is well-defined, and 
computable, we need to refine the notion of L,(G) for generic maps. 

We start in the Euclidean setting. Let G : R” — R” be smooth with a fixed point 
p € R” and define for some closed neighbourhood cl U C R” around p, containing 
no other fixed points, the map g : JU > S”~! by 


G(q)-4 


—__ 3.8 
IG@) alk oe) 


Sigh gQge= 


Then, let the generalized local Lefschetz number L p(G) be equal to the degree of 
this map, that is L,(G) = deg(g). For this construction to be of any use, the degree 
must be invariant under a change of neighbourhood U. Pick any other closed neigh- 
bourhood cl U’, strictly contained in cl U, then, as g extends to cl U \ U’, the degree 
vanishes on the boundary of this set by means of Lemma 3.3. However, by construc- 
tion, this implies that the degree under both neighbourhoods must be equal (as the 
induced orientations must be the opposite), see also [16, p. 127]. If cl U and cl U’ 
merely have a non-empty intersection, then, one first finds a larger closed neighbour- 
hood cl U" that contains both sets and the previous argument extends. Moreover, it 
can be shown that when p is a Lefschetz fixed point L(G) = L,(G) [16, p. 128]. 
The following result is instrumental in linking local Lefschetz numbers. 


Proposition 3.3 (On local Lefschetz numbers [16, pp. 126—129]) Let the smooth 
map G : R” — R” have some isolated fixed point p* and let B” be an open ball 
containing p* such that clB” does not contain any other fixed points of G. Next, 
pick a map G’ that equals G outside of some compact subset of B” and has all 
its fixed points in B” being of the Lefschetz type. Then, the pair (G, G’) satisfies 
L(G) = eer, L(G’) for pe a“ 


Proof (sketch) First, L p (G) equals the degree of the map g : 3B” —> S”~! defined 
via (3.8). By construction, on R” \ B”, G can be replaced with G”. Let pı, ..., pk 
be the set of Lefschetz fixed points of G’ in B” and let (B”"); C B” be a disjoint 
set of sufficiently small balls around those points such that dB” N (U; By") = Ø. Let 
B’ = B” \ UB", considering (3.8) for G’ over dB’ > S’—!, by construction this 
map extends to B’ such that by Lemma 3.3 the degree of this map must equal 0. Then 
the claims follows by observing that 0B’ consists out of dB” and 3{U; B} }, with for 


the latter set(s) the orientation being flipped with respect to B”. 


Now, given a general smooth map G : M” — M” with isolated fixed point p*, let 
w : U — R” bea diffeomorphism around p* mapping p* to 0 and consider yw o G o 
yo! : R” — R”. First, assume that p* is a Lefschetz fixed point, hence, DG p» — 
In is an isomorphism. See that in coordinates one has D(yyo Go vo — In = 
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Dyp o (DG p — In) o Dyg’ such that the local Lefschetz number is preserved. 
For generic fixed points, employ Proposition 3.3. Homotopy invariance, generality 
of Lefschetz maps and Propositions 3.2—3.3 lead to the following generalization. 


Theorem 3.5 (General Lefschetz numbers [16, p. 130], [17, Sect.2.C]) Let G: 
M” —> M” be a smooth map over a smooth, boundaryless, compact, oriented man- 
ifold M” with finitely many fixed points. Then, 


L(G) = X a EO), (3.9) 


Remark 1 (Axiomatic degree theory [9, Appendix B], [33, Chap. IV]) Degree theory 
on closed manifolds is powerful, yet sometimes restrictive. It turns out that the 
concept can be generalized axiomatically to closed subsets of R”. Inspired by the 
properties of deg(-) one can derive a map d(G, D, q) with these desirable features 
like (3.4), where now G : D > R”isaC’=° map over some bounded set D C R” and 
q is a regular value such that G~!(q) ¢ 3D. We will not appeal to this construction, 
but regarding further reading this is important to be aware of. 


3.5 Poincaré—Hopf and the Bobylev—Krasnosel’skii 
theorem 


Lefschetz fixed point theory allows for analyzing flows and discrete-time dynamical 
systems, however, we are ultimately interested in continuous-time dynamical systems 
and particularly vector fields. The reason being, first principles possibly provide one 
with a differential equation approximating® some phenomenon, having access to an 
explicit solution (flow), however, is rare. Hence, we switch from maps to vector 
fields on M, where the set of C’-smooth vector fields on M is denoted by X” (M), see 
Sect. 5.1 for more details on continuous-time dynamical systems. 

We will start again on R” and define the vector field analogue of the local Lefschetz 
number, as introduced by Kronecker/Poincaré and formalized by Hopf. 


Definition 1 (Index of a zero) Consider some open set Q C R” and let p* € Q be 
an isolated zero of the smooth vector field X € ¥°({2). Let U be a neighbourhood 
of p* such that p* is the only zero of X over cl U and define the map v : JU > S""! 
by v : pt X(p)/||X(p)|l2. Then, the index of p* is defined as 


ind ,«(X) = deg(v). (3.10) 


Indeed, if one is not aware of X € ¥% (Q) having a zero on U C Q, index compu- 
tations provide a partial answer. To lift the construction to manifolds, one can show 


6 We like to already emphasize that most tools discussed in this work are particularly suitable when 
models are only roughly known and one is after insights into qualitative behaviour. 
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that (3.10) is invariant under diffeomorphisms [29, p. 33]. This will be shown after 
establishing the link between vector field indices and local Lefschetz numbers. 


Proposition 3.4 (Vector field indices and Lefschetz numbers [16, pp. 135-136]) Let 
X be a smooth vector field over some open neighbourhood Q C R” of the origin, only 
vanishing at 0. Let {gy : t > 0} be a family of mutually homotopic maps, smoothly 
mapping Q to itself, with o% = I, and for t + 0, g% having no fixed points besides 
0. If X (p) is tangent to p% (p) at t = 0 for all p € Q, then 


indo (X) = Lo (g4). (3.11) 


Proof (sketch) First, by direct integration, one can show that if g(t) is a smooth func- 
tion, then there is a smooth function r (t) such that g(t) = g (0) + t(d/ds)g(s)|s—o + 
t°r (t). Then, fix p € Q and apply this coordinate-wise to p% (p) as seen as function in 
t, that is 9 (p) = o(p) + t(d/ds)¢y (P)|s=0 + R(t, p), for R(t, p) the vector- 
valued remainder term. Rearranging yields yy(p) — p = tX (p) + t? R(t, p). By 
construction, for p # 0 and t # 0 we have o(p) — p # 0 and as such 


px(p)-p _ X(p)+tRG, p) (3.12) 


loxP) — plz IX(p) +2 R(t, Plo 


is well-defined. The left part of (3.12) can be identified with Lo (gx), whereas the 
right part defines a homotopy in t. For t = 0 we recover indg(X) and as the degree 
is homotopy invariant the result follows (only use this last argument on the right). 


Proposition 3.4 is of interest in its own right, but in particular, to show the following 
invariance. Let X be a smooth vector field over M with some isolated equilibrium 
point p*. Let U be a neighbourhood of p* and let y be a diffeomorphism from U onto 
a neighbourhood V of 0. As such, the pushforward Dw o X o Y~! = yX defines 
a vector field in local coordinates. In particular, we have 


indy (WX) = Lolo}, x) = Lp (9%) = ind. (X), (3.13) 


where we exploit that M can be embedded in some Euclidean space. Most impor- 
tantly, this shows that the index is well-defined on manifolds. Also see that (3.10) is 
purely local and does not rely on M being orientable. See Section 5.1 for the formal 
introduction of the pushforward of a vector field X under a smooth map w. 

Given the aforementioned discussion, let a vector field X, with only isolated 
zeroes, give rise to a flow Py: Indeed, the fixed points of this flow are the zeros 
of X. Moreover, for sufficiently small t, gẹ behaves similar to the identity map. In 
this case the Lefschetz number collapses to the Euler characteristic x (M); this is the 
Poincaré—Hopf theorem, named after its initiator and key contributor. 


Theorem 3.6 (Poincaré—Hopf theorem [29, p. 35]) Let M be a smooth, compact, 
oriented, boundaryless manifold. Then, for any smooth vector field X € X” (M) 
with only isolated zeroes { p7};ex C M one has 
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xM) = X indy (X. (3.14) 
icT 


Proof Hopf preferred a combinatorial/algebraic approach [19, Chap. 1], we, how- 
ever, follow [16, p. 137], embed M in some Euclidean space R? (which we can do 
with d < 2dim(M) + 1 by our topological assumptions on M [27, Chap. 6]) and 
construct a tubular neighbourhood U of M. Then, by Proposition 3.1 we know we 
can find a U such that the normal projection z : U > M is a C™ retraction. As 
M is compact, p + tX (p) will be contained in U for sufficiently small t > 0 and 
any p € M. Then, construct the map ø‘ (p) = 7(p+tX(p)). For any p € M we 
have 


> '(p)li=0 = X (p) 
ar? P= = Pp), 


such that Theorem 3.5 and Proposition 3.4 apply if we can show that the fixed 
points of gy’ equal the equilibrium points of X. Any zero of X leads to a fixed 
point of gy’. Since x is a normal projection, any other fixed point must have tX (p) 
being perpendicular to T,M, which implies that X (p) must be 0. Then as g? is idm 
and homotopic to gy’ (for sufficiently small t > 0), the result follows as L (idm) = 
1(Am, Au) = xM). 


It is known that the Poincaré—Hopf theorem can be used to assess if vector fields 
have unique equilibria over compact sets, early remarks of this nature can be found 
in [36, 43]. In the context of dynamical control systems, similar tools have been used 
in [2, 3, 7, 8, 12, 21, 32, 37, 42] and more recently in [20, 24, 25, 44]. This approach 
can also be seen in the context of economics [10, 28], quantum mechanics [1] and 
optimization [38]. We will also exploit the theorem extensively. 


Corollary 3.1 (Poincaré—Hopf theorem for continuous vector fields) Let M be as in 
Theorem 3.6. Then, for any continuous vector field X € X"=°(M) with only isolated 
zeroes {p} }iez C M, (3.14) holds. 


Proof (sketch) As illustrated on [34, p. 23], Theorem 3.3 asserts the existence of 
a smooth map Y : M > TM being ô-close and homotopic to X. We cannot simply 
assume that this map will also be a vector field. However, let g = x o Y for the 
natural projection x : TM — M, which we can assume to be a diffeomorphism. Now 
let X” = Y o g7! : M > TM and see that 2 o X® = idp. Then the result follows 
from the homotopy invariance of 7, i.e., I (X, Z,(M)) = 1(X™, Z,(M)) = x (M). 


For linear systems x (t)=Ax (t), with det(A) > 0, one has indg(Ax) = sgn det(A) 
[22, Theorem 6.1]. This can be extended to nonlinear systems by appealing to the 
Hartman-Grobman theorem [22, Theorem 6.3]. One show this by showing that ori- 
entation preserving diffeomorphisms are homotopic to the identity map cf. [29], 
see also Example 3.3 below. The take-away is that hyperbolic (structurally stable) 
equilibrium points have index +1. 

Next we provide a typical non-trivial example with a degenerate differential at 0. 
Therefore, one cannot appeal to the hyperbolic formula from above. 
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(ii) 


Fig. 3.4 Vector field indices with the gray lines being typical integral curves; (i): unstable radial 
vector field with indo(X) = 1; (ii): reflection map with indg(X) = —1; (iii): the vector field from 
Example 3.3 with indg(X) = 0; (iv): a vector field with homoclinic orbits and indg(X) = 2 


Example 3.3 (Degenerate equilibria) Consider a vector field X € ¥® (R?) given 
by X(p) = (p?, —p2). Clearly, p* = 0 is the only equilibrium point. To com- 
pute indọ(X), see from Fig.3.4(iii) that y = (1, 1) is regular value of the map 
v(X(p)) = X(p)/I|X(p)ll2 for both p =27"?(—1, —1) and p = 2721, —1). 
Hence, from (3.4), we get indọo(X) = 1 — 1 = 0. 

On R2, the vector field index corresponds to the so-called winding number, 
also called the Cauchy index or Poincaré index [11]. In particular, one computes for 
X(p)= (p?, — p2) = (X1, X2), as in Example 3.3, the index of 0 as, 


dé = 0. 


20 
X1dXq — XodX] 1 | — cos(0)? — 2 sin(@)2 cos(@) 


1 
indo (X) = = 
000 = z / X24 x2 Qn cos(0)4 + sin(@)2 
Ši 1A 5 


So, in dimension 2, the index corresponds to how often the vector X,,.;) rotates 
counter-clockwise when moving along a path y (t) counter-clockwise (in line with 
the standard orientation on R°?) around the isolated equilibrium point [16, p. 192], 
see Fig.3.4 for some more examples. See [11, Sect. 1.2] for more on the relation 
between the degree as defined via intersection theory or differential forms. 

Next we provide as an example the Bobylev-Krasnosel’skii theorem—that will 
play a central role in the remainder of this work. 


Example 3.4 (Index of isolated locally asymptotically stable equilibrium points: 
the Bobylev-Krasnosel’skii theorem) Consider X € X"(M") with p* € M” being 
some isolated locally asymptotically stable equilibrium point. We cannot assume 
p* to be hyperbolic and follow [23, Chap. II], [22, Theorem 52.1] [40]. Without 
loss of generality consider X in local coordinates and assume 0 to be an isolated 
asymptotically stable equilibrium point. Let cl r” be a sufficiently small closed ball 
around 0 (occasionally written using D” = cl B”) such that X has no other zeroes 


7 See [11] for the definition using differential forms, which is outside the scope of this work. 
On R? one can simply understand this as integrating over dO for 6 = arctan(X2/X1). For 
instance, let X(p) = (pj, p2), then, indg(X) = (27)! fx dd = 2)! for pidp2 — p2dpı = 
(21)~! fE” cos(0)? + sin(@)2d0 = 1. 
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on clrB”. To aid the computation of the index, we recall that the degree is invariant 
under homotopy. A similar notion holds for the index. We say that two vector fields, 
as seen as maps, are vector field homotopic when the entire homotopy itself does not 
vanish.® This means the vector fields themselves must be nondegenerate over their 
domain. Akin to Example 3.2, one can show that if this is true, the corresponding 
indices agree [23, Theorem 5.5]. For example, consider in Fig.3.4 scenario (i) and 
(ii), the corresponding maps, from S! to itself, are not homotopic and indeed, the 
indices do not agree. A particularly useful ramification is the following, given two 
nondegenerate vector fields X; and X2 over W. If X; and X3 are never oppositely 
directed, that is, 


Xi(w) X2(w) 
|X1(w) ll || X2(w) ll 


W, 


then as in Example 3.2, a convex combination of X; and X3 entails a vector field 
homotopy, see also [23, Theorem 5.6]. Now consider the vector field —X and its 
relation to the flow gy 


= —X(p). (3.15) 


By continuity and the fact that ¢ is nonnegative, (3.15) implies that p — ọ%(p) 
and —X(p) will not be of opposite sign for sufficiently small t > 0. However, by 
asymptotic stability p — y(p) # 0 for t > 0. Hence, we have constructed a vec- 
tor field homotopy. However, asymptotic stability also implies that for t —> +00 
the map p> p—g'(p) eventually tends to the identity map. This proves that 
indg(—X) = indo (ide pr) = 1 cf. (3.12). For indo (X), observe that for a map g over 
some n-dimensional domain deg(g) = (—1)"deg(—g) such that indg(X) = (—1)”. 
Then, by the invariance under diffeomorphisms (3.13) we get that ind p (X) = (—1)”. 


The index result from Example 3.4 appeared for the first time in [4] and was 
largely extended and popularized by Krasnosel’skii and Zabreiko [22]. However, 
it is likely that the results where known, e.g., to Poincaré [35, Chap. XVII] and 
Anosov [4], presumably since it appeared to be an “obvious fact” [4, p. 1043]. With 
respect to that body of literature is important to remark that the rotation of a vector 
field was the invariant of choice. For all practical purposes in this work, that concept 
is the same as the vector field index. For the subtle difference see [46]. 

Results analogous to Example 3.4 for Lyapunov stable- or attractive isolated 
equilibrium points are less transparent, but motivated by the work of Zabczyk [45] we 
provide a short remark. One severe complication is that asymptotic stability is locally 
of interest, just as Lyapunov stability, solely zooming in on attractivity, however, is 
mostly interesting on the global level due to the interplay with the (global) topology. 
For example, consider globally attractive isolated equilibrium points on S! and S?. 
By the Poincaré—Hopf theorem, those equilibrium points must have vector field index 
0 and 2, respectively. If those points would be merely locally attractive, the indices 
could be —1 and 1, respectively. As was already pointed out in [22], it is known that 


8 We will not appeal to proper homotopy theory here, or “nonsingular deformations“cf. [22]. 
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equilibrium points that are merely Lyapunov stable can in general have any index [5]. 
For attractivity the statement is also subtle and depends on the domain over which 
the system is attractive. From Example 3.4 we see that locally, the arguments of 
local asymptotic stability carry over. However, see that in both cases we exploit the 
properties of a continuous flow. In [30] this is relaxed, the vector field is continuous, 
but solutions are not necessarily unique nor do they necessarily depend continuously 
on initial conditions. See also the proof of Theorem 6.2 for a way around exploiting 
the direct existence of a flow. 


Example 3.5 (Case study Sect. 1.3: Lie groups) Consider any compact Lie group 
G” with n > 1. As one can construct a non-vanishing smooth vector field on G” by 
pushing-forward any fixed non-zero v € T.G” under some left translation L; [27, 
Theorem 8.37], it follows from Theorem 3.6 that x (G”) = 0, compactness is impor- 
tant here. We return to this frequently. 


To make use of the Poincaré—Hopf theorem one needs to assert that an appropriate 
vector field exists. This can be shown using Thom’s transversality theorem. 


Proposition 3.5 (Existence of vector fields with isolated equilibrium points) On 
every smooth compact manifold M there exists a vector field with only finitely many 
isolated zeroes. 


Recall Example 3.3, the following result due to Hopf shows that, up to homotopy, 
equilibrium points with vector field index 0 can be ignored. Compactness is key here. 


Proposition 3.6 (Nowhere-vanishing vector fields [16, p. 146]) A compact, con- 
nected, oriented, smooth manifold M has x(M) = 0 if and only if there exists a 
continuous nowhere-vanishing vector field X on M. 


See Example 5.1 for an application of Proposition 3.6 and see Chapter 6 and 
Section 8.2 for further generalizations of Theorem 3.6. 

For references on differential topology, see for example [6, 13, 16, 18, 26, 27, 
29]. For more on degree theory in particular, see [11, 16, 18, 33, 46] and [9, 31] in 
the context of control theory. See [14] for an exposition on the generality of index 
theory and [15] for a general, beyond continuity, axiomatic treatment of index theory. 
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Chapter 4 ®) 
Algebraic Topology get 


4.1 Singular Homology 


First, we briefly introduce homology groups, for a complete—or even axiomatic— 
treatment, see for example [1, 4, 8]. In particular, there is a multitude of homology 
theories, all with their relative merits. We highlight Eilenberg’s singular homology. 
The intuition goes back to Riemann and Poincaré and is as follows. Compact two 
dimensional surfaces can be characterized by their genus, that is, the number of holes 
(or handles). Extending this, one can consider classifying topological spaces based 
on how many k-dimensional “holes” they have and so forth. Here, the dimension 
of the hole should be understood as a the smallest dimension of a closed manifold 
enclosing the hole, e.g., S! is said to have a single 1-dimensional hole. 

More formally, let X be a topological space and let o : A% —> X be any continuous 
map from the standard k -simplex A‘ = {p € R*+': a pi = 1, pi = Ofori = 
0,1,..., k} into X, called a singular k -simplex. Now recall the introductory remarks 
on groups from Sect. 1.3, yet, to work with these singular maps we need to introduce 
more concepts from algebra. Let G be an Abelian (commutative) group, then Z C G 
is a basis of G when G is the smallest subgroup of G that contains Z and is such 
that every g € G can be expressed as a formal sum (meaning, for general “+”) 
g = } ; a;b; with a; € Z, bi € Z and only finitely many œ; being non-zero [5, 
Theorem I.2.8]. Then, while omitting the (motivating) details, given any set Y the 
so-called free Abelian group generated by Y is given by {}_; aiy; : yi € Y, a7 € Z 
and finitely many œ; are non-zero } [5, Chap. II], which is an additive group. 

We also recall the notion of a group homomorphism, that is, given two groups 
(G, ©), (H, -), a map z : G > H such that z(g, -© g2) = z(g1) -“ z(g2) for 
all g1, g2 € G. The set of group homomorphisms between G and H is denoted by 
Hom(G, H). In case H is Abelian, (Hom(G, H), -) is itself an Abelian group with 
the group operation being defined pointwise by (z1 - z2)(g) = z1(g) -™® z2(g) for all 
Z1,Z2 € Hom(G, H) and all g € G. 

Now let C; (X) denote the free Abelian group generated by all singular k-simplices, 
called the singular chain group, containing elements, called k-chains, of the form 
$; qio; for o; a singular k-simplex. For instance, for Cı (X), one can think of o; : 
[0, 1] —> X as giving rise to a path (or point) in X. Recall that paths enclosing on itself 
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(loops), and in general maps from n-spheres, contain a lot of topological information. 
However, this homotopy approach does not necessarily detect all “holes” we are after 
in an intuitive manner, e.g., Hopf found a non-trivial map from the 3-sphere to the 
2-sphere. This is one reason to use the singular chain groups instead. In particular, 
one can define a boundary operator ð that acts on C;,(X) as 


i C00 C900 S e (4.1) 


and satisfies 0, o 0441; = 0 (boundaries have no boundaries). In the context of singular 
homology this map can be made explicit. To that end, define the face embedding 
Fux: Ak! cs AK as follows. Let {eo, €1,..., eg} be the set of vertices of A. Then, 
F; x is such that it maps A*~! to the face opposite to the vertex e; € A*. Note that 
A‘| itself is a face of A‘. Now for o € C;(X) the boundary operator can be defined 
as oo = EEE lie o F; x, where ð% o 0441; = O can be verified. 

Then, a k-chain c € Cx (X) is called a k-cycle when ðc = 0. Differently put, the 
set ker(0,) © C(X) contains all k-cycles. See also that when b € Cx+1(X), then, 
x41 € ker(d,) since 3 (d%41b) = 0. Now, the k" singular homology group of X is 
defined as Hy, (X; Z) = H(X) = ker(d,) /im(0,¢41). As such, H; (X; Z) = 0 when all 
k-cycles are boundaries of (k + 1)-chains, that is, there are no k-dimensional holes. 


Example 4.1 (The Oth singular homology group) Let X be path-connected.' we 
will follow [6] and show that Hj(X; Z) = Ho(X) = ker(d9)/im(0,) ~ Z. First of 
all, by (4.1) see that ker(d9) = Co(X). Now for any 0-chain c = 7, ajo; construct 
the index map I : Co(X) > Z by I(c) = }_; a;. Evidently, this map is a surjec- 
tive homomorphism. We will show that ker(/) = im(0,), which implies that Z is 
isomorphic to Ho(X) by the first isomorphism theorem for groups.” Pick any singu- 
lar 1-simplex o, then ðo = o(1) — o (0) and indeed Z (ðo) = 0. This implies that 
im(0,) C ker(/). For the other direction, fix a point in X, say x’, and let y (x) denote a 
continuous curve from x € X to x’, which always exists as X is path-connected. This 
means that for any 0-chain c = $; a;x; (recall that o; = x; in this case), we have 
O(a; Y W(x) = YC; aixi — I (c)x'. Therefore, if I (c) = 0, then c can be written 
as the boundary of a 1-chain and hence ker(/) C im(d,). This concludes showing 
that Hp (X) ~ Z. When X consists out of p components, this argument is generalized 
to showing that Ho(X) ~ Z’. See also [1, p. 172] for a similar explanation. 


To provide another important example, H,(S’=!; Z) ~ Z for k € {0, n} and 0 
otherwise. Similarly, given a subspace A of X, one can consider the homology 
group of X “modulo A” as follows. Define the relative chain group C;,(X, A) = 
Cx (X)/C,(A) and analogously the (relative) boundary operator da, : Ck(X, A) > 
Cx_1(X, A). Then, the k-th singular homology group of X relative to A is defined as 
Ay (X, A; Z) = Ay (X, A) = ker(da,x)/im(0a,441) [4, p. 115]. When A Æ Ø is closed 


L A topological space X is said to be path-connected when for any x, y € X there is a continuous 
function g : [0, 1] —> X such that g(0) = x and g(1) = y. 

2 The statement is as follows, let G and H be groups and let z be a group homomorphism. Then, 
im(z) is isomorphic to G/ker(z) [6, Theorem C.10]. 
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and a neighbourhood deformation retract of X, then H; (X, A; Z) = H, (X/A; Z) [4, 
Proposition 2.22], for Hy the reduced homology, i.e., Hy ~ Hy for k > 0 and 
Ho > Ay @ Z [4, p. 110]. Whenever k is irrelevant, we write H), where H, is 
also common notation. Omitting details, when X is a compact manifold, then Hy (X) 
is a finitely-generated Abelian group such that the rank of H; is simply the number 
of Z summands used to describe the group [4, Sect. 2.2]. However, H;,(X) is by no 
means finitely-generated in general, consider a plane with uncountably many holes. 

Now, dual to the homology groups, one can define via C K(X) = Hom(C,(X), Z) 
the k-th singular cohomology group of X via the so-called induced coboundary 
operator 5§ : CK(X) + C! (X) as H(X; Z) = H*(X) = ker(6*) /im(6*+!) [4, 6]. 
Then, Poincaré duality allows for linking homology and cohomology groups of X [4, 
Sect. 3.3], e.g., Hy(M”; Z) ~ H”-*(M"; Z), for appropriate M” (see below). 

The power of singular homology does not necessarily lie in computation, but in 
the ability to prove relationships between several homology groups. To that end, given 
a continuous map G : X — Y define the homomorphism Gy : C,(X) > C,(Y) by 
Gy(o) = Goo for any singular k-simplex o € C;,(X). The explicit formula for the 
boundary operator reveals that Gy(0,0) = Ək (G (0o )). Note that at the LHS of this 
equality the operator 0, acts on C(X) whereas on the RHS ð acts on C,(Y). This 
means that Gy maps cycles to cycles and so forth. As such, Gy induces a homo- 
morphism G, : H(X; Z) > A, (Y; Z). It readily follows that for two continuous 
maps G; : X > Y and G2: Y > Z we have (G2 o G1), = Go, o Gi,. We are now 
equipped to state the following lemma. 


Lemma 4.1 (Homology homotopy invariance [4, Corollary 2.11]) Let G : X —> Y 
be a homotopy equivalence, then, the induced homomorphism G, : H(X; Z) > 
H;(Y; Z) on singular homology is an isomorphism for any k > 0. 


Lemma 4.1 is commonly proved by first proving that for homotopic maps their 
induced homomorphims are equivalent [4, Theorem 2.10]. Then, one uses that if 
G : X — Y is a homotopy equivalence, there must exist a map G” : Y —> X such 
that G’ o G%pidx and similarly, G o G’~;,idy. However, this implies that G’, o G, = 
(idx), and G, o G! = (idy),. Therefore, G, must be an isomorphism. 

An elementary implication of Lemma 4.1—which will be of use in Chap. 6—is 
that by homotopy equivalence between R” \ {0} and S""! for n > 2, the singular 
homology groups of R” \ {0}, for n > 2, become 


Z ifke{0,n—1 
HR" \ {0}; Z) ~ E (4.2) 
0 otherwise 


Now, let G : S” —> S” be a continuous map, then, the degree of G as described in 
Sect. 3.4 can be equivalently defined by means of the induced homomorphism G,, 
that is, as the integer deg(G) such that G,(H,,(S"; Z)) = deg(G)H,,(S"; Z), e.g., 
see [1, Chap. IV]. This definition of the degree also immediately works for maps 
G : M” — N” over oriented, connected, compact manifolds as H,,(M"; Z) ~ Z (by 
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Fig. 4.1 Vector field on a 
triangulation 


the universal coefficient theorem [1, Chap. V]) [7, Sect. I.2]. We return to this 
viewpoint below and in Chap. 6. 


4.2 The Euler Characteristic 


To link the previous chapter with the geometric definition of the Euler characteristic 
as set forth in Sect. 2.3, find Fig. 4.1. A single triangle is constructed using 3 vertices, 
3 edges and | face, as such this adds up to an Euler characteristic of 1. Similarly, see 
that we can construct a vector field with 3 sources, 3 saddles and 1 sink, adding up 
the vector field indices agrees with the Euler characteristic. 

This can be formalized using homology theory, which will be briefly outlined 
below. First, one generalizes the 2-dimensional Euler characteristic formula by 
appealing to Whitehead’s CW complexes [4, 6]. Informally put, a CW complex 
is a space constructed by glueing together k-cells, that is, topological k-dimensional 
balls. These cells can be of different dimension and the glue is applied to the bound- 
ary of the cells. More formally, let Xo be some discrete space and construct X; by 
attaching some collection {C}; } jez of open 1-cells to Xo via a collection of continuous 
maps p; : ƏC; — Xo, that is, X; = Xo U g(UjdC;). One can continue this proce- 
dure and construct X2 C X3 C --- C Xn by attaching open k-cells of appropriate 
dimension. If a topological space X can be written as X,, for some n > 0, as defined 
above, then X has a cell decomposition @, where the 0-cells are given by Xo, the 
1-cells by X; \ Xo and so forth. The pair (X, @) is called a cell complex. This cell 
complex is a CW complex when it satisfies the following two properties 


1. The closure of each cell is contained in a union of finitely many cells; 
2. The topology of X is coherent with {clC : C € @}. 


See [6, p. 135] for examples that fail to meet both conditions. 
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Definition 4.1 (The (combinatorial) Euler characteristic [6, Chap. 6]) Let X” be 
a finite dimensional CW complex, with ng the number of k-cells of X”. Then, the 
Euler characteristic of X” is defined as 


xX") = 2 (Dén. (4.3) 


Although all equivalent under compactness assumptions, e.g., see Theorem 4.2 
below, we call (4.3) the combinatorial definition of the Euler characteristic. This 
definition shows in particular that for non-compact spaces homotopy invariance of 
X (-) does not necessarily hold, e.g., compare x for an open and a closed interval. 


Example 4.2 (The CW structure is not unique: the 2-sphere) Recall that the sphere 
S? can be constructed from a 2-cell (a disk) and 0-cell (a point), hence x (S*) = 2. 
Similarly, one could fix two poles and construct S? from two 0-cells, two 1-cells (two 
intervals) and two 2-cells, adding up to x (S?) = 2. 


See also [9] for a less straightforward matrix manifold example. The combinatorial 
formula (4.3) is particularly appealing due to the following result. 


Proposition 4.1 (CW equivalences [4, Corollary A.12]) Any compact topological 
manifold is homotopy equivalent to a finite CW complex. 


Next, we provide the homological definition of x (X"), here, by = rank H(X”; Z) 
denotes the k-th Betti number of X", i.e., when H;,(X; Z) is finitely generated, we 
have H,(X"; Z) ~ Z” ® Ty, for T, the torsion [1, p. 258, 282]. Compute for instance 
Ho (RP"; Z) to see T Æ 0. In that sense, we should speak of “holes” and “twists”. 


Theorem 4.1 (The (homological) Euler characteristic [4, Theorem 2.44]) Let X” 
be a finite CW complex. Then, the Euler characteristic of X" equals 


xX") = LCV". (4.4) 
=( 


It follows from Poincaré duality that for closed.’ oriented manifolds one has 
rank H; (M”; Z) = rank H"~*(M’"; Z), and by the universal coefficient theorem that 
rank H;,(M"; Z) = rank H*(M"; Z) e.g., see [4, Corollary 3.37]. However, then we 
have 

rank H,,—,(M”; Z) = rank H,(M”; Z), (4.5) 


see [4, Sect. 3.3] for the omitted details. A similar argument holds for non-orientable 
manifolds, such that by (4.4) the following result follows. 


Corollary 4.1 (Odd-dimension Euler characteristic [4, Corollary 3.37]) A closed 
manifold M of odd-dimension has x (M) = 0. 


3 In this context, closed means, traditionally, compact and without boundary. 


54 4 Algebraic Topology 


Proof (Sketch) Combining (4.4) with (4.5): x (M) = bo — bi +- -- + bi — bo = 0. 


Note that for oriented manifolds, Corollary 4.1 can also be shown using oriented 
intersection theory, cf. (3.5). When M has a boundary, Corollary 4.1 is not true, 
consider the interval [0, 1]. We will return to Corollary 4.1 frequently. 

We end with one of the pillars of topology, linking the seemingly different def- 
initions of the Euler characteristic. See Sect. 8.3 for comments on Morse theory. 


Theorem 4.2 (The Euler characteristic [2, Theorem 8.6.6]) Let M be a closed, 
oriented, smooth manifold, then the corresponding combinatorial Euler character- 
istic (4.3), homological Euler characteristic (4.4) and the Euler characteristic from 
oriented intersection theory (3.6) all agree. 


Proof (Sketch) Recall the relation between Morse indices and cells in a CW struc- 
ture, e.g., see Theorem 8.2 below. Then, following [2], construct a Morse function 
g : M” — R with m; critical points of index k, for k = 1, ...,m. Now, using Theo- 
rem 8.2 and Definition 4.1 it follows that x (M”) = } `, (— 1)*m,. However, note that 
the vector field index for an equilibrium point (critical point of g) with Morse index 
k equals (—1)*, and we have m; of them. As such, Theorem 3.6 (Poincaré—Hopf) 
tells us that x (M”) = >>, (—1)*m,, which is exactly what we had before. Then, the 
relation to homology follows from Theorem 4.1. 


Observe that compactness is important as x (R”) = (—1)” according to the combi- 
natorial definition (4.3) while x (R”) = 1 according to singular homology (4.4). 

We refer the reader to [3] for an illustrated introduction to algebraic topology and 
to [1, 4, 8] for complete treatments. 
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Chapter 5 A) 
Dynamical Control Systems ciecie; 


5.1 Dynamical Systems 


We start by clarifying notation and terminology. Let M be a topological manifold, 
(T, -)acommutative topological group withe € T denoting its identity element, i.e., 
s-e=e:-s=sVs€T and let gy: J xM — M te a continuous map. The triple 
(M, T, p) is a dynamical system when the following axioms are satisfied 


(i) the identity property: (e, p) = p for all p € M; and 
(ii) the group property: o(s -t, p) = o(s, v(t, p)) for all s,t € T and p € M. 


When 7 = R the map ọ is said to be a (global) flow. In that case, the axioms are 
conveniently written as o° = idy and ° og! = g**' Ys, t € R, with gy’ denoting 
the homeomorphism g(t, -) : M —> M. Indeed, see that a flow naturally induces the 
homotopy equivalence y' (U)~;,y* (U) for any s, t € Randopenset U C M. See also 
that (M, 7, o) is time-invariant in the sense that o(s, p) only depends on the current 
point p € M and the “time” s to propagate, i.e., o(s, ¢(s7!, o(s, p))) = o(s, p). 
Let M be a smooth manifold and let X € X” (M), with r € N U {oo}, denote a 
C’-smooth vector field over M, that is, X : M —> TM is a C’-smooth map and 
Tp o X =idm for x, being the canonical projection z, : TM — M defined by 
Tp : (p, v) +> p, sometimes simply written as x. Equivalently, C” vector fields X 
on M can be understood as C” sections of the tangent bundle, denoted X € T” (TM). 
The evaluation of X € X” (M) at p € M is a tangent vector X (p) = Xp € T,M. 
Then, a differentiable curve £ : Z C R — M, for some appropriate interval Z, is 
called an integral curve of the vector field X when é (t) = X(E(t)) forallt € T. A 
manifestation of a flow that will be of interest is as a map parametrizing all integral 
curves of a vector field. Given a vector field X € ¥" (M), then via the relation 


d , = j 
T’ (p) an X(@ (p)), (5.1) 


we can define a C” local flow g : dom(gy) —> M, where the regularity is commonly 
with respect to the second argument of the flow. See that the map t +> '(p) is 
always at least C! when the flow is generated by a continuous vector field. A flow 
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is not necessarily well-defined for all t € R or even all t > 0,! e.g., consider x = x? 
with x(0) = 1. When X does give rise to a globally well-defined flow the vector field 
is said to be complete. Regarding the case study from Sect. 1.3, every left-invariant 
vector field on a Lie group is complete [43, Theorem 9.18]. In particular, any smooth 
vector field over a compact manifold is complete [43, Theorem 9.16]. When a flow 
originates from a vector field X, we denote this by gy. 

We will follow the terminology from Chap. 3; given a smooth map G, we speak of 
the differential of G or the pushforward under G, denoted DG and G,,, respectively. 
Now we formalize what this means in case G acts on vector field or is a vector field 
itself. Following [43], given a smooth map G : M > N the pushforward of G at p € 
M, thatis, DG, : TpM — Tg p)N, is defined pointwise by DG p(X p)g = Xp(g 0 G) 
for any smooth function g : N — R and any (p, Xp) € TM. Here, the action of a 
tangent vector X, ona C ' function g should be understood, in coordinates, as the 
directional derivative of g in the direction of X ,. To turn this pointwise pushforward, 
that is, all the vectors DG p(X p), into a vector field on N, we must be able to supply 
any point q € N and get an element in 7,N, that is, we need p such that G(p) = q. 
Hence, we assume G to be a C’t! diffeomorphism and compose with G~', this 
defines the pushforward G,,X of a vector field X € X" (M) under G as the vector 
field G,.X € X(N) satisfying (DG(X)g) o G7! = G,,Xg for any smooth g : N > 
R cf. Sect. 3.5, also understood via the following diagram 


M —& N 


J Jex 


TM 2$ TN 


Moreover, we make frequent use of the differential of X € ¥"=! (M) at p € M such 
that X (p) = 0, written as DX, : TpM —> Typ) TM. With some abuse of notation this 
map is, however, commonly written as DX, : TpM —> T,M such that, in coordinates, 
one can consider the eigenvalues of DX ,. This simplification hinges on the fact that 
for p € M, X : p > (p, v) with v € T,M such that the first part of DX, : T,M > 
Tx (p) TM is just the identity map on T,,M, hence the simplification. Note, without 
imposing further assumptions, this “connection-free” construction of DX , will only 
make sense when X, = 0 € T,M. To see this, recall that X € %'=!(M) induces a 
C’=! (local) flow g’ : M —> M[43, Theorem D.5]. Now, consider the time-derivative 
of Dg’, : TpM > To:(p)M and see that we work within the same tangent space when 
p is a fixed point of yg’. In that case we do not need additional structure and can 
define DX, : T,M — T,M via 


d t 
a ee” = DX pv, v € T,M. 


"A flow defined over Rs is usually called a semiflow, as it does not satisfy flow property (ii). 
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Via (5.1) one can observe that in coordinates this construction entails the Jacobian of 
X. One can also see this from Tx(p)=0T M > T,M È T,M [2, p. 72] or by observing 
that the non-Euclidean part of the covariant derivative vanishes [42, Chap. 4]. 

As most of this work will be centred around providing necessary conditions, 
we will not be further concerned with integrability. We point the reader to, [43, 
57, Appendix D], [62, Appendix C] and note that a uniquely integrable continuous 
vector field X € %7=°(M) under locally Lipschitz regularity conditions gives rise to 
a unique maximal flow gy : T x M — M, for some Z C R. To simplify the overall 
exposition, we will assume—unless stated otherwise—the following throughout. 


Assumption 5.1 (Unique global integrability) Every vector field X € X’=°(M) 
considered in this work is complete and uniquely integrable, that is, X gives rise to 
a unique global continuous flow gy : R x M—> M. 


Nevertheless, notable results that can do with weaker assumptions will be highlighted. 
Next we introduce a notion due to Birkhoff [10, p. 197]. 


Definition 5.1 (The w-limit set [56, p. 148]) Given a flow g on a topological man- 
ifold M, the w-limit set of p € M is 


o(9, p) = Nr>z0 l U,>r tp (P) (5.2) 


Differently put, as we work with global flows (complete vector fields), y € 
æw(p, p) when there is a monotonically increasing sequence {tn}nen C R with 
limao ty = +00 such that lim, 9” (p) = y [2, Proposition 6.1.2]. The w-limit 
set captures any type of asymptotic recurrent behaviour, like the convergence to 
equilibrium points but also limit cycles and so forth, as further detailed below. Anal- 
ogously, one can define the a-limit by reversing time. When generalizing Defini- 
tion 5.1 to sets P C Mitis important to see that w(g, P) is not necessarily equivalent 
to Upep w (Q, p). 

Recall, given a vector field X € X” (M), we call p* € M an equilibrium point of 
X when X, = 0 € TM, equivalently, w (yx, p*) = { p*}. The point p* is called 
isolated when there is an open neighbourhood U C M of p* such that for all p € 
U \ {p*} one has X, # 0, equivalently, œ (9x, p) # {p} for all p € U \ {p*}. Note, 
this is different from an isolated set in the sense of Conley cf. Sect. 8.5. Away from 
equilibrium points the flow is locally a straight line [53, Theorem 2.26]. This flow- 
box theorem indicates why the behaviour around equilibrium points is interesting to 
study, but also that periodic orbits are inherently hard to study locally. 


Definition 5.2 (Hyperbolic equilibrium points [55, p. 58]) Let p* € M” be an equi- 
librium point of X € X>! (M"). Then, p* is a hyperbolic equilibrium point if 
DX p : T pM” —> TM” defines a hyperbolic linear vector field, that is, all eigen- 
values (in coordinates) of DX p in R”*” have a non-zero real part. 


2 Note, here we exploit Assumption 5.1, if the integral curves would not be unique then zeroing the 
vector field is not sufficient, e.g., consider x = y |x]. 
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w 


(i) (ii) (iii) 


Fig. 5.1 Definition 5.3: (i) Lyapunov stability; (ii) attractivity; and (iii) asymptotic stability 


Hyperbolic equilibrium points are generic [55, p. 58] and isolated, cf. Propo- 
sition 3.5. Next, we define the qualitative behaviour of interest for time-invariant 
dynamical systems. 


Definition 5.3 (Time-invariant stability notions of equilibrium points) Given a vec- 
tor field X € X” (M) defining the system (5.1) we distinguish the following notions 
of stability for an equilibrium point p* € M of X: 


(i) Lyapunov stability: for each neighbourhood U, of p* there is neighbourhood 
Us of p* such that for all pọ € Us one has yy (po) € Ue for all t > 0, that is, 
gy (Us) E Ue for all t > 0; 
(ii) Local attractivity: there is a neighbourhood U of p* such that for all po € U 
one has lim; +00 9 (po) = p*; 
(iii) Local asymptotic stability: p* satisfies both (i) and (ii). 


If (ii) holds with U = M, then the point p* is globally attractive and similarly, if 
p* is globally attractive and stable in the sense of Lyapunov, then, p* is globally 
asymptotically stable, see Fig.5.1. If (i) fails to hold, p* is called unstable. 


We will be mostly interested in studying asymptotic stability, however, not only 
regarding equilibrium points. A compact set A C M is called a local attractor of 
the flow g when A is @-invariant, that is, y'(A) C A for all t € R, and there is an 
open neighbourhood U C M of A such that N;>o g'(U) = A. In fact, this is equiv- 
alent to saying that the invariant set A is locally asymptotically stable [28, Lemma 
1.6].° Attractivity is clear, for Lyapunov stability, consider for example Fig. 1.1(vi), 
+0 9'(U) will correspond to a set which is both not closed and open, e.g., of the 
form [a, b). Indeed, lacking Lyapunov stability or lacking local attractivity are not 
mutually exclusive notions, see also [26, Sect. 40]. 

As global asymptotic stability will turn out to be often impossible, we make a 
special distinction, we will consider local asymptotic multistability, e.g., all isolated 
equilibrium points of X € %"(M) are locally asymptotically stable. The importance 


3 The literature does not agree on terminology here cf. [9, Definition V.1.5]. 
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of this notion follows from the fact that having multiple attractors means that distur- 
bances can qualitatively change the nominal behaviour, moving from one attractor 
to another. Multistability appears for example in the study of laser dynamics [6] 
and neural networks [14], with the importance of multistability being especially 
acknowledged in biology, e.g., see [5, 41, 49]. 

So far, everything was qualitative, yet, when imposing a metric on M, stability 
(the rate of convergence) can be quantified [12, Sect. 6.1.5]. See [25] for the relation 
between asymptotic- and this quantitative notion called exponential stability.* Also, 
a metric enables handling non-compact attractors, e.g., see [73, Sect. 3]. 

When the dynamical system is time-varying, e.g., when X : T x M —> TM with 
T C R is a continuous time-varying vector field, we need to generalize our stability 
notions. First note that time-varying vector fields do not necessarily give rise to flows, 
however, time-dependent generalizations are possible [43, Theorem 9.48]. One still 
speaks of £ : T — M as an integral curve of the time-varying vector field X when 
é (t) = X(t, &(t)) for all t € Z, however, one might do with a weak solution to the 
differential equation. That is, one allows for Ẹ to be merely absolutely continuous and 
to satisfy the differential equation almost everywhere, with respect to the Lebesgue 
measure. In what follows, when a vector field is time-varying, we take this viewpoint, 
see [1, Chap. 4], [12, Appendix A], [62, Appendix C] and [30] for more on solutions 
of time-varying vector fields. In general, for a time-varying dynamical system the 
e — 6 definition of Lyapunov stability might depend on time, that is, 5 might depend 
on time. When this is not the case, we speak of uniform stability, which coincides 
with stability in case the vector field is time-invariant. Similarly, one can extend the 
other notions of stability, see [36, Sect. 4.5], [18, Sect. 11.2] and Example 6.4 below. 
In particular, see [69, Sect. 5.1] for illustrative examples of the aforementioned 
stability notions due to Massera and Vidyasagar and see [66] for misconceptions 
when it comes to uniform stability. In particular, a lack of uniformity can compromise 
robustness, e.g., ô — 0 for t — +00. 

Now given an equilibrium point p* € M for some vector field X € X” (M), it is 
worthwhile to characterize the set of points that flow towards p* under X. 


Definition 5.4 (Domain of attraction of an equilibrium point) Let p* be a local 
asymptotically stable equilibrium point of X € ¥" (M) defining the system (5.1). 
The domain of attraction of p* is the set 


Dox, p*)={p EM: lim, vy (p) = p*}. (5.3) 


With some abuse of notation one could also write D(yx, p*) as œ~! ({p*}). The 
domain of attraction is also called the basin- or region of attraction and is in other 
work occasionally denoted as B(p*) or A(p*). Estimating the domain of attraction 
has a variety of applications, for example in cancer treatments [51, 58]. See also 
the 1985 survey paper by Genesio, Tartaglia and Vicino for more historical con- 


4 Given a continuous vector field « = f(x) with f(0) = 0 on R”, then, the origin is said to be 
exponentially stable when there are C, 4 > 0 such that ||! (xo) || < Ce™™ ||xo]| for all x9 € R”. 
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Fig. 5.2 Continuous transformation of Stepanova’s model, removing the malignant equilibrium 


text [23]. For general attractors A C M, one generalizes Definition 5.4 consistently, 
thatis, D(x, A) = {p € M : limy 400 gr (p) =a, a € A, for some monotonically 
increasing sequence {t,}nen C R, with limy oo tn = +00}. 

In general, an equilibrium point p* € M of some vector field X € Æ" (M) is 
not locally asymptotically stable. In this case it might be of interest to split 
M, locally, in stable and unstable parts. Assume that p* is a hyperbolic equi- 
librium point under the flow gy and define the so-called stable and unstable 
“manifolds” of p* by W* (gx, p*) = {p € M: w(@x, p) = {p*}} and W" (gx, p*) = 
{p € M: a(x, p) = {p*}}. As p* is hyperbolic one can split T,M as T, M = 
T, W° (px, p*) ® Tp» W” (px, p*). In fact, Tp*M splits according to the generalized 
eigenvectors of DX». More can be said about these stable- and unstable manifolds, 
see [33, Chap. 6]. Also, when p” is not hyperbolic one can appeal to center manifold 
theory, e.g., see [13, 29]. 

This section ends with two explicit vector field examples from biology. 


Example 5.1 (Tumor immune interactions) Returning to Chap. 3, in particular, 
Hopf’s result (Proposition 3.6) tell us that indices adding up to 0 can be effectively 
“homotoped away”. This observation is of use when one wants to know if a certain 
dynamical systems can be “continuously deformed” into another dynamical system. 
Here, we look at an example that models tumor immune system interactions [58, 
Chap. 8]. Stepanova’s model is given by the following set of equations 


7 = F —Opr 
p pF (p) l P (5.4) 
r=a(p— Pp jr + y — ôr, 
where p represents tumor volume, r the immunocompetent cell density, F(p) a 
growth rate and all other parameters are constant coefficients. For common choices of 
parameters, (5.4) has two stable equilibrium points, a benign state b* and a malignant 
state m*, separated by a saddle s*, see Fig. 5.2(i). A question of interest is if (5.4) 
can be deformed such that only the asymptotically stable benign equilibrium state 
prevails. Using the theory of vector field indices we see that s* and m* have indices 
of opposite sign such that they can be morphed into ‘s*, see Fig. 5.2(ii). Similarly, as 
this intermediate equilibrium point has index 0, it can be removed completely, see 
Fig. 5.2(iii). Indeed, as b* has index 1, as is the Euler characteristic of the rectangular 
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Fig. 5.3 Dynamical (control) systems: (i) a parametrization of a double helix DNA model on 
SE(3, R) corresponding to Example 5.2 and (ii) the circuit corresponding to Example 5.4 


domain, and the vector field is pointing inwards, the existence of this transformation 
was guaranteed from the start, see also Sect. 8.2. 


Example 5.2 (DNA conformation [37]) In this example we model the DNA double 
helix as an elastic rod that has a helical twist at its minimum energy conformation. 
One can parametrize this model by a coordinate frame moving along a curve in 
R?. Moreover, this curve has a, possibly arc-length-dependent, matrix attached to it, 
describing its mechanical properties like stiffness. Now, to move along this curve, the 
instantaneous change in orientation and position need to be supplied, i.e., a rotation 
and a translation. This parametrization naturally leads to the employment of the 
special Euclidean group, defined as 


R t 


SE(3, R) = } A e R®*: A= 
01x3 1 


|: R € SOG, R), rer}. 


Here, for a A € SE(3, R), R describes the rotation and t the translation. For any 
point p € R?, the propagation under A € SE(3, R) is as follows, append 1 to p, i.e., 
let p = (p, 1) € R4, then Ap = (Rp + t, 1) € R4, i.e., first p is rotated to Rp, then, 
this point is translated to Rp + t. Now, the potential function that characterizes the 
energy of the DNA conformation will only consider relative changes in the curve 
parametrizing the DNA model. As such, we will always look from the so-called “body 
frame”. To that end, see that for any differentiable curve s œ> A(s) € SE(3, R) 


d R(s)"R(s) RTC) 


aoao] 03 j ]e#@.R = T „SE(3, R). 


With this observation in mind, let € be the vectorization of A`! Å, denoted E= 
(Aq! A)Y with inverse £^ = AT! À, details can be found in [52], but are irrelevant 
for this example. Now, one defines a quadratic elastic potential energy function, 
for a DNA double helix modelled as an unconstrained extensible rod, by U (£) = 
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5E'KE — k! £ + B, for some positive definite K € R°*°, k € R° and £ € R. Mini- 
mizing U over £ results in £* (s) = K~!k and therefore 


A Ae = A(s)(K~'k)*, (5.5) 
ds 


is a vector field on SE(3, R), that describes, locally, a DNA double helix model 
corresponding to the pair (K, k). To appreciate the geometric construction, the reader 
is invited to find the curve related to (5.5) directly. 


5.2 Lyapunov Stability Theory 


In this part we provide a brief overview of the stability theory as devised by Lya- 
punov [46]. The tools are fruitful in their own right, but as it turns out, the levelsets of 
Lyapunov functions are intimately related to the domain of attraction of the attractor 
at hand. A fairly general result is the following. 


Theorem 5.1 (Compact attractors and Lyapunov functions [8, Theorem 10.6]) Let 
ọ be a continuous flow on a locally compact Hausdorff space X. The compact set 
A CX is a local attractor under if and only if there is continuous function V : 
D(g, A) > Rso such that 


(i) V(x) = Oforallx € A; 
(ii) V(x) > 0 for all x € D(ọ, A) \ A, the sublevel set V~'({0, c]) = {x € D 
(Q, A) : V(x) < c} is compact for all c € [0, +00) and; 
(iii) V(p'(x)) < V(x) for all x € D(ọ, A)\ Aandt > 0. 


A function V as in Theorem 5.1 is called a strict continuous Lyapunov function. The 
word “strict” refers to item (iii), i.e., the inequality is strict. Without strictness, attrac- 
tivity of A cannot be asserted, merely Lyapunov stability. As we almost exclusively 
consider attractors, the adjective “strict” is dropped in the remainder of the book. 
See that the sublevel set compactness assures the V is (weakly) coercive, e.g., for 
x — 0D (qg, A) such that ||x|| — +-oo, V(x) — +00. See for example [26, p. 109] 
for more on the necessity of this condition, see also Example 5.3 for a geometric 
interpretation. Note that the results in [8] are with respect to (local) semi-dynamical 
systems, however, by Assumption 5.1 we do not need to concern ourselves with semi- 
dynamical system technicalities like “start points”. See also [9, Chap. V] for a variety 
of Lyapunov theory, albeit for locally compact metric spaces. Although outside of the 
scope of this work, Theorem 5.1 does not apply as is to infinite-dimensional system, 
for infinite-dimensional Lyapunov theory, see for example [50]. 

Moreover, the results due to Kurzweil [38, Theorem 7], Massera [48] and Wil- 
son [72] indicate that there should always be a smooth and proper? Lyapunov function. 
However, in contrast to popular belief, it took until the work by Fathi and Pageault 


5 That is, the sublevel sets of V are compact. 
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in 2019 to formally show this for flows generated by vector fields on smooth mani- 
folds® [21]. See the proof of Theorem 6.2 for an application. 

The key benefit of a smooth Lyapunov function is that explicit knowledge of the 
flow in Theorem 5.1 (iii) can be substituted by a simpler condition. Let X be a continu- 
ous complete vector field on a smooth manifold M and let A C M be an attractor under 
the flow yy. Then, there is a smooth and proper function V : D(x, A) > Rso such 
that A = {x € D(x, A) : V(x) = 0} and the Lie derivative? Ly V(x) < 0 for all 
x € D(x, A) \ A. Such a function V is called a smooth Lyapunov function, again 
omitting “strict”. For example, for x = —x> one readily verifies that V(x) = $x? 
is a smooth Lyapunov function that asserts global asymptotic stability of x* = 0. 
See [15, 65] for further generalizations and see [35] for a survey on converse Lya- 
punov theorems. We also point out that the global continuous converse problem was 
solved by Conley and coworkers and is often referred to as “Conley’s Fundamental 
Theorem of Dynamical Systems”. The theorem states that “Any flow on a compact 
metric space decomposes into a chain recurrent part and a gradient-like part.”, 
see [54]. We return to this in Sect. 8.5. 


Example 5.3 (Topology of a Lyapunov function (73, Theorem 1.2]) Consider a con- 
tinuous vector field x = f(x) on R”, with f (0) = O such that 0 is globally asymptot- 
ically stable and let V : R” — Rs» be the corresponding smooth Lyapunov function. 
By assumption, (0,V(x), f(x)) < 0 on R” \ {0}, such that for any c € (0, +00) one 
crosses the level set V. = V~!(c) once. Moreover, as we have the homeomorphism 
p'r (Ve) >19} (Ve) for all t, s € R, we find by exploiting the flow properties of y, that 
V. x R ~, R” \ {0}. However, as the trivial bundle V. x R is homotopic to V, and 
R” \ {0} ~} S”! we can conclude that V.~;,S’~'. Better yet, as V, is compact, the 
resolution of the (a) Poincaré conjecture yields that V, ~, S”-!, See also [38, Sect. 
5] for earlier topological remarks and for example [23, Theorem 2] for early remarks 
on ramifications of V, ~, S’~!. 


Finding explicit Lyapunov functions is usually hard [4] and contradicts being 
a (direct) “method” [32], but as upcoming sections illustrate, their mere existence 
provides to be useful. Moreover, as Theorem 5.1 holds for locally compact Haus- 
dorff spaces, and not just topological manifolds, one can generalize a few upcoming 
Lyapunov-based results beyond topological manifolds indeed. 


5.3 Control Systems 


We start by illustrating how the study of a control system on a manifold can emerge. 


Example 5.4 (DC Converter [75, Sect. 3.5], [44]) We will consider a so-called DC- 
to-DC converter as employed in laptops, phones and so forth. An idealized model can 


6 In particular, see [21, Sect. 1, Sect. 6] and [65] for clarifications. 
7 See [43, Chap. 9] for more on Lie derivatives. 
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be constructed as in Fig. 5.3, here the switch is used to either charge the left or right 
capacitor, by means of the inductor, thereby, one can control the potential (voltage) 
over these capacitors. The equations of motion follow from Vz (t) = L(d/dt) Iz (t), 
Ic(t) = C(d/dt) Vc (t) and Kirchoff’s laws 


Ci Vi (t) d -—u)b(t) 
— | C2,V2(t) | = ul3(t) i 
L3h(t) —(1 — u) Vi (t) — u V(t) 


where C1, C2 denote the capacitance, L3 the inductance andu € {0, 1} the switching 
signal, that is, the input to the system. Now, consider the change of coordinates x; = 
CÌ V, x2 = C}? V and x3 = LY h with x = (x1, x2, x3) € R°. Then let E(x) = 
5 (x, x) and observe that d/dt E(x(t)) = 0. This means that if the system starts from 
some initial condition x9 € R3, total energy is preserved and the system evolves on 
a 2-sphere with radius (2E (x9))!/2. Now, the reader is invited the draw qualitative 
conclusions from x (S?) Æ 0. We also remark that although the switching signal is 
binary, in practice one does not use such an idealized switch but rather a type of 
transistor. As such, u is not binary but rather continuous. 


Example 5.5 (Quantum control [20]) Let |w(t)) € H be the state of a quantum 
system at time ¢, for some complex Hilbert space H. Assume we work with a two- 
level system, that is, |y(t)) = co(t)|0) + c,(4)|1), for |0), |1) € H and both t => 
co(t) and t +> c(t) are complex-valued functions satisfying |co(t)|? + |e, (t)|? = 1 
for all t, i.e., the state is normalized. Let Ho be the internal Hamiltonian and let 
the external part be of the form pen H; ug(t), for all H; Hermitian operators on 
H and t +> ug(t) real-valued (input) functions. Then, Schrédinger’s equation, i.e., 
ih|w(t)) = H|w(t)), becomes 


d = li ae 
in YO = (a + 2 A0) Y(t), (5.6) 
=] 


for W(t) the evolution operator and H; the Hamiltonian in (co, c1) coordinates. One 
might be interested in steering Y(0) = Jp to some desirable operator at some time 
T > 0. With this goal in mind, we can without loss of generality assume that all Hj are 
traceless. By doing so, we merely ignore a physically indistinguishable phase differ- 
ence. Now see that (5.6) is of the form W(t) = AW(t) with A = —i/hH. However, 
now also consider the special unitary group SU(n, C) = {Z € C'™" : ZZ = I} 
with Lie algebra su(n, C) = {A € C”*” : AH + A = 0, Tr(A) = 0} and see that 
A € su(2, C). As Y(0) = hy is the identity element on SU(2, C), we see that (5.6) 
is in fact a (right-invariant) control system on the Lie group SU(2, C) cf. Sect. 1.3, 
unlocking Lie group machinery. 


The purpose of the control system paradigm is to study if and how dynamical 
behaviour can be prescribed, e.g., the stabilization problem is that of finding inputs 
such that some set is stabilized in some sense. Control systems defined on manifolds 
can either be studied locally, that is, in some operating region of interest, or globally. 
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The most common local continuous-time formulation of a continuous time- 
invariant nonlinear dynamical control system is of the form 


betes | “x = f x(t), u), (5.7) 


for x(t) € X C R” and u € U C R” the state and input, respectively, e.g., see [53, 
57]. One can append (5.7) with (time-invariant) output functions of the form y(t) = 
h(x(t), u). These functions capture for example what one can measure. However, we 
will work directly with the state x(t) and in that sense we restrict ourselves to a class 
of open dynamical systems with identity (or trivial) outputs [71]. This assumption is 
not restrictive as we will look at obstructions to achieving certain control objectives. 
Working with outputs y(t) instead of all state variables x(t) directly will only lead 
to more complications. We come back to this in Chap. 8. 

When the input is chosen as a function of x, e.g., as u(x) € U, we speak of u as 
being a feedback or control law. Note, as with the curve € and the points p and x, 
we use u instead of u to differentiate between the function and the point. When jz 
depends on time, the input is said to be time-varying. A description like (5.7) works 
in Euclidean spaces or by using local coordinates on a manifold. However, as we 
are mostly interested in global questions we are aided by the following coordinate- 
free description, often attributed to Brockett, that allows for state-dependent input 
constraints, e.g., see the early work by Willems and van der Schaft [70, Definition 
6]. Note, here we will not appeal to knowledge of a metric cf. [62, p. 123]. 


Definition 5.5 (Continuous control system) Given a smooth manifold M, a continu- 
ous control system is the triple X = (M, U, F), consisting of a topological space U, a 
continuous surjective map zr, : U — M, the canonical projection z, : TM —> M and 
a continuous fiber-preserving map F : U —> TM such that the following diagram is 
commutative: 


U —=> TM 


N a 
M 


Definition 5.5 implies that the available inputs at x € M are characterized by 
the sections T° (U), i.e., the continuous maps o : M — U such that x, o o = idp. 
Indeed, let Y = R” x R”, then F relates directly to (5.7). More interestingly, con- 
sider U to be for example a disk bundle (tubular neighbourhood of M), which cor- 
responds in coordinates to the input being constrained to a topological disk. In the 
framework of Definition 5.5, a continuous control law (feedback) u € T° (U) results 
in the continuous closed-loop system F o u : M —> TM. Note that instead of assum- 
ing F and u to be continuous maps, one could consider a larger class of systems by 
only demanding that the vector field F o u is continuous. See also [24, 39, 53, 64]. 
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Example 5.6 (Case study Sect. 1.3: modelling) Consider the left-invariant vector 
field (1.1b) over a lie group G. This model is analogous to x = u with u € R”, as 
such, the control system becomes © = (G, TG, idtg). 


Example 5.7 (Affine control systems) Motivated by mechanics, one of the most stud- 
ied nonlinear dynamical control system models is of the input-affine form, cf. [53], 


described by a set of vector fields { f, g1, . . - , gm} and an input taking values in R” 
aff d m 

Zam : gO = f(x@) + » 8i (x(t))uj- (5.8) 
i=1 


Globally, £", corresponds to zz, : U —> M being a vector bundle [53, p. 428]. 


n,m 

To put the class of continuous feedback laws in perspective, we must be able to 
describe generic admissible behaviour, that is, we must be able to describe all trajec- 
tories that can result from applying an admissible—and potentially discontinuous— 
input to the control system. Albeit its importance and attention received, this task, 
that falls under the umbrella of “controllability”, is only partially solved. Loosely 
speaking, the control system £ = (M, U, F) is said to be controllable when for any 
x1, X2 € M there is a finite T > 0 and an “admissible input’ such that the “resulting 
integral curve” starting at xı arrives at x2 in time T cf. [53, Definition 3.2], [57, 
Definition 11.1]. The notion of an admissible input depends evidently on the appli- 
cation at hand, but let us highlight common mathematical assumptions. To that end, 
consider momentarily a control system in local coordinates, when studying dynam- 
ical control systems of the form x = f(x, u), the input might depend on time in a 
merely measurable (i.e., possibly discontinuous) way. As such, an integral curve that 
satisfies this differential equation cannot always be continuously differentiable. 

To analyze this scenario, let f : R x Q —> Q be continuous with Q open in ¥ 
and rewrite the standard initial value problem, that is, finding a curve € such that 


LO = £80), E(t) = Ens wm <€intZ), forteZCR 


as that of finding a curve € : Z — Q such that E(t) = En + i f(t, €(t))dt for all 
t € L. The integral representation of the initial value problem immediately reveals 
that demanding £ to be C!-smooth is not a necessity. Moreover, from a practical point 
of view, the integral problem is as relevant as the differential equation. Therefore, the 
right® setting is that of absolutely continuous curves, that is, curves £ : T > Q that, 
when restricted to compact subsets of Z, admit an integral representation of the form 
E(t) = E(t) + N g(t)dt for some Lebesgue measurable function g : Z —> Q with 
t € [f, t1] C Z. Then, one speaks of a (weak) solution to the initial value problem 
when one finds an absolutely continuous curve € : Z —> Q, that passes through £n € 
Q at to € Z, such that E(t) = f(t, &(t)) holds for almost every t € T in the sense of 


8 Although even weaker regularity notions can be desirable, see Sect. 7.3. 
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Lebesgue. To assert existence one commonly appeals to Carathéodory’s sufficient 
conditions, that is, t +> f(t, £) must be measurable for all £ and E£ b f(t, €) must 
be continuous for (almost) all t. This implies in particular that t œ> f(t, &(¢)) is 
measurable. Moreover, for each compact set K C Z x Q there must be an integrable 
function bx (t) such that || f (t, €)|| < bg (t) for all (t, E£) € K [27, Sect. 1.5]. 

Now we return to dynamical control systems and briefly comment on classes of 
inputs that are frequently employed. The input t > w(t) € U with t € Z is said to 
be locally integrable when f g WH(t)|\dt < œœ for all compact subsets 7 € Z (with 
|| - || from R”). We denote this by u € L} T). On the other hand t + u(t) € U is 
said to be locally essentially bounded when for each compact set J C T there is a 
compact set K C U such that u(t) € K for almost every t € J. This set is denoted by 
LY.(T). When the control system is input-affine, we can select u € Lie (T) to assert, 
locally, the Carathéodory conditions, notably, the last condition. In general, when 
f(x, u) is jointly continuous in x and u one select u € LR (Z) [62, Appendix C]. 

With this motivation and the control system © = (M, U, F) in mind, we define 
the set of admissible inputs over the interval Z, denoted by Y (T), as all maps u : 
(T C R) x M — U witht > u(t, x) being measurable for all x € M, x œ> u(t, x) 
being continuous for all t € Z and in particular u(t, -) € T?(U) such that controlled 
trajectories are absolutely continuous curves € : J —> M such that 


Tsw = (F o u) (t, E(t)) fora.e.t € T and some u € Y(T). 


With this in place we return to the question of controllability. Global controllability 
is unfortunately difficult to characterize. To study controllability and its ramifications, 
locally, we follow Lewis [45] and define the reachable set from x, € Min time T > 0 
as Rs(xı, T) = {E(T) : there exists a controlled trajectory £ : ZT —> M such that 
&(0) = xı and [0, T] € Z.}. Let Ry (x, T) = User Ry (x, t), then we say that È is 
accessible from x € M if int(Rs (x, R>0)) Æ Ø. Similarly, £ is locally controllable 
from x € M when x € int(R»(x, Rso)). The control system È is small-time-locally- 
controllable from x € M if there is a T > O such that x € int(Rs(x, [0, s])) for 
all s € (0, T]. Based on the control system at hand we will spell out—as far as 
possible—which type of controllability can be asserted and how. When the goal is to 
stabilize a set A C M one might make a distinction between controllability on M \ A 
and on A itself. See [45] for a relatively recent overview of geometric nonlinear 
controllability and see [34] for earlier survey paper by Kawski. See also [22] for the 
parallel development of exploiting so-called “flatness”. 


Example 5.8 (Linear controllability and continuous feedback) Consider the linear 
control system £4 = (R”, R” x R”, F € L(R" x R”; R”)), succinctly given by 


x = Ax + Bu, (5.9) 


for some A € R”*” and B € R”*”. Note, here one exploits the identification TR” ~ 
R” x R”. It readily follows that the integral curves t +> &(t) € R” corresponding 
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to (5.9) are of the form (T) = e74E(0) + ed eT—>4 B u(s)ds for some T > 0 and 
some choice of admissible input t œ> u(t), e.g., u € L} AAO: T]). The linear control 
system ©} is controllable if and only ifrank(B, AB,..., A"! B) = n, which readily 
follows from comparing the rank of (B, AB,..., A”! B) to the rank of e'^ B cf. [62, 
Theorem 3]. Instead of referring to £}, one frequently refers to the pair (A, B), 
which is said to be a controllable pair in case EŻ} is controllable. Now, one can 
show that if (A, B) is a controllable pair, so is (A + BK, B), for any K € R”*” [74, 
Lemma 2.1]. Better yet, one can show that there is a Ky € R”*” and a ug € R” 
such that (A + B Kọ, Bug) is a controllable pair [74, Lemma 2.2]. Note, with some 
abuse of notation, the resulting control system x = (A + BKo)x + (Buo)u is now a 
controllable single-input system. Then, for the moment assume m = 1, B = b and 
that (A, b) is a controllable pair, i.e., the matrix T = (b, Ab,..., A"—'b) has rank 
n. Due to the Cayley—Hamilton theorem, performing a linear change of coordinates 
Tz = x can be shown to result in 


00. —a\ 1 
er 1 0 see AQ ~ 
T'AT=A=| | |, Tlb=b=|.}. (5.10) 
0 -. : : 
00 1 -a, 0 
for some tuple (a1, ..., an). Then, consider the pair (A, b) given by 
—d, —d2 ++: —an 1 
_ 1 0... 0 _ 0 
A = 5 b — 
0 : : : 
0 0 1 0 0 
A pair of the form (A, b) is controllable for any tuple (a), d2,..., án) and is said 


to be in the control canonical form. Hence, as any controllable pair can be trans- 
formed as in (5.10), there must exist an invertible linear transformation S such that 
any controllable pair (A, b) can be brought into this control canonical form [67, 
Chap. 3]. To that end, assume that (A, b) is a controllable pair in canonical form and 
let k € R!*", then, by employing the feedback u(x) = kx one finds that the charac- 
teristic polynomial of A + bk is of the form A” + (kı — aA"! +--+ (kn — an). 
Therefore, one can “place” the eigenvalues of A + bk anywhere desired by an appro- 
priate selection of k. Concluding, we have shown that for any controllable linear 
dynamical system £7 there is a tuple (Ko, uo, k, S7!) such that the linear feedback 
u(x) = Kx = (Ko + uokS'!)x globally asymptotically stabilizes x* = 0. 


In general, however, controllability as is does not provide any information on 
how the input should be selected, e.g., the input space might contain any measurable 
function. To that end, we highlight a variety of continuous stabilization paradigms 
with respect to a continuous control system È = (M, U, F). 
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(i) Static feedback: Control laws are continuous sections o : M > U. 

(ii) Dynamic feedback: This is most easily described in coordinates by passing 
from static feedback in u, i.e., x = f(x, u) to dynamic feedback in u and v, i.e., 
x = f(x, u), Zz = v. Here, both inputs can depend on x and the auxiliary state- 
variable z. In the context of input-output systems one commonly encounters 
the more restrictive form x = f(x, z), žē = v. 

(iii) Time-varying controls: Similar to dynamic feedback, one can describe a time- 
varying vector field by lifting the state space, that is, by writing x = f(t, x) 
as x = f(s,x), Ss = 1. In this case, the time variable is understood to live in 
a subset of R. If instead the time variable lives on S! the system is periodic, 
e.g., § = —Js for J € Sp(2, R) (the Symplectic group) corresponding to a 
clockwise rotation. Crucially, the introduction of the auxiliary variable s will 
require a different analysis as $ ~ 0 and solutions generally diverge to +00, 
see Example 6.4. 


As highlighted in the introduction, in what follows we focus on continuous feedback 
laws due to implementation and robustness considerations, but also to investigate the 
limitations of this common assumption. As dynamic and time-varying controls can 
be modelled by means of vector fields on extended state spaces, this is a good initial 
vantage point. However, keeping these distinctive classes in mind is important. For 
example, Coron and Praly showed that there are systems that cannot be stabilized 
by static feedback while a stabilizing dynamic controller exists [19]. This result 
relates to what is a common observation in topology, extending state spaces can 
enable continuity.” To give a simplified example on R?, for Ff (1, x2) = (x1, —X2) 
one has indo(f) = —1 4 (—1)”, while for f(x, x2, X3) = (x1, —X2, x3) one has 
indo( f ) = —1 = (—1)"*' cf. Example 3.4. Moreover, Coron showed that stabilizing 
time-varying controllers are significantly more rich in that they usually exist [16, 17]. 
We have more to say about this in the upcoming two sections. See also [68] for more 
on the application of dynamic feedback. Note, in all of the aforementioned we focus 
on state-feedback, meaningful extensions to non-trivial outputs are still open. In the 
past the focus was mostly on local stabilization of equilibrium points, i.e., a controller 
induces a well-behaved closed-loop system on a neighbourhood of the equilibrium 
point. We like to understand what could happen outside of this operating region. 
Exactly then, the global topology of the underlying space plays a critical role. 


Example 5.9 (Control-Lyapunov functions) Assume to work with a input-affine 
control system of the form (5.8) and let x* = 0 be the point to be stabilized under 
a feedback u that satisfies u(x*) = 0. If we can find a smooth and proper function 
V : R” — Ryo that only vanishes at 0 and is such that for all x € R” \ {0} there is a 
u € R” such that (0,V(x), f(x) + X; g;(x)u;) < 0, then V is a control-Lyapunov 
function (CLF) [62, Lemma 5.7.4]. Such a construction is particularly interesting 
when the inputs are known to be constrained. Although controllability does not imply 
the existence of a stabilizing continuous feedback, when V is a CLF and additionally 


° Consider embedding the figure 8 in R? and in R3. 
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satisfies the small control property," then, the work by Artstein [7] and Sontag [60, 
61] shows that an explicit continuous stabilizing feedback law can be found. As will 
be shown, the existence of CLFs is thereby easily obstructed based on topological 
grounds. See also Sect. 7.3. 


Remark 5.1 (From stability to continuous stabilization) As continuity is preserved 
under compositions, a common approach to provide topological obstructions to con- 
tinuous stabilization is as follows. Assume one can show that there does not exist any 
continuous vector field X € X=? (M) that satisfies property P. In its turn, this result 
directly implies that for any control system © = (M, U, F) in the sense of Defini- 
tion 5.5, there is no continuous feedback u : M — U such that the closed-loop vector 
field F o u satisfies property P, e.g., there is no continuous feedback law on M that 
can achieve this type of stabilization. 


For more on dynamical systems, see [8, 9, 31, 33, 55, 56, 59], for more on 
Lyapunov theory, see [9, 36, 62] and for more on geometric control theory, see [3, 
11, 12, 18, 29, 53, 57]. See [3, Sect. 8] for a discussion on the topology of attainable 
sets, also called reachable- or accessible sets. Although we focus on smoothness and 
continuity, in part due to converse Lyapunov theorems, see [63] for an overview of 
how real-analyticity presents itself as an important setting for the study of control 
theory. We also remark that the work by Lur’e and Postnikov [47] was one of the 
first that—amongst other things—linked Lyapunov stability theory to control theory, 
whereas the book (and invariance principles) by Lefschetz and LaSalle [40] was key 
in promotion of the concept. 
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Chapter 6 A) 
Topological Obstructions ciecie; 


Given a continuous control system © = (M, U, F), or merely the manifold M, in 
this chapter we consider stability and stabilization on three levels. 


(i) What is the topology of an admissible attractor A C M? 
(ii) Given an attractor A, what is the topology of the domain of attraction D C M? 
(iii) Given the pair (A, D), what kind of dynamics are imposed on M \ D? 


Regarding the notions of stability and stabilization, we primarily focus on (uniform) 
asymptotic stability and continuous static feedback, but note in passing if these 
obstructions prevail under other stabilization paradigms. To summarize the list of 
above, see Fig. 6.1, we want to understand how the topology of M influences stability 
and stabilization possibilities. 

We will address Questions (i)—(iii) above, by looking at the stabilization of points, 
submanifolds and generic sets. The obstructions differ in being of a local or global 
nature.' Moreover, some require knowledge of the vector field (dynamical system) at 
hand, whereas other obstruction hold for example for any continuous flow on M. For 
instance, with respect to the stabilization of some equilibrium point, an elementary 
necessary condition on © is that F(U) N Z,,, (M) Æ Ø, or stronger, for a particular 
point p* € M it must be true that (p*, 0) € F (m! (p*)). Similarly, for the stabiliza- 
tion of some invariant submanifold A <> M one needs F (x7! (a)) N (a, TaM|a) 4 Ø 
for alla € A. For a generic compact attractor A C M, however, one needs that for all 
p € OA the set F(x; '(p)) does not only contain pairs (p, v) with v pointing out- 
ward of A, which is asserted in local coordinates. Similar conditions can be stated 
in the language of involutive distributions” on M [94]. It turns out that incorporating 
topological aspects of the control system results in significantly deeper insights 
than the mere existence of equilibrium points and so forth. 


' Here, the difference between these settings is best understood as that in the global setting one does 
have explicit knowledge of the domain of attraction, in contrast to the local setting. 


? A fruitful concept, yet outside the scope of this work. 
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(i) (ii) (iii) 


Fig. 6.1 Given M, (i) what is the topology (to be understood as the homotopy type) of the attractor; 
(ii) what is the topology of the domain of attraction; (iii) how does this fit into M, what kind of 
qualitative dynamics are imposed outside of D? 


One of the first principled overviews towards answering Question (ii) appeared 
in the book by Bhatia and Szegö [10, Sect. V.3]. Early comments on how the global 
topology in combination with the Poincaré—Hopf theorem imposes an obstruction 
for stabilization appeared in 1988 by Koditschek [71]. Similar comments appeared 
in [72] with respect to navigation problems and obstacle avoidance. As the focus is on 
generic results, we omit early specialized (low-dimensional) results, e.g., early work 
by Dayawansa,* see [38] and references therein. We also omit explicit discussions 
about obstructions due to quantization and the like. 

With respect to Question (i), we mostly focus on compact attractors, the main 
reason being that asymptotic stability of a compact attractor can be characterized 
solely by topological means, cf. Sect. 5.1. Besides, a set of equilibrium points is 
closed [10, Theorem II 2.7], so that if M is compact, any subset A C Mon which some 
vector field vanishes is necessarily compact.* See also [79] for how compactness of 
A turned out to be a necessity in correcting a topological result due to Wilson. 


6.1 Obstructions to the Stabilization of Points 


Equipped with the tools from Chaps. 3-5, we start by considering the stabilization of 
an (equilibrium) point p € M, either locally, or globally. We emphasize that locally 
asymptotically stable equilibrium points are isolated, yet, to aid the reader we do 
occasionally keep the adjective isolated. 


3 However, we like to emphasize that Dayawansa inspired a lot of work we do discuss. 


4 The proof of [10, Theorem II 2.7] relies on M being a metric space. However, under our assump- 
tions, the result can be shown via embedding M in some Euclidean space R? as well. 
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6.1.1 Local Obstructions 


In this section we mostly focus on local nonlinear models of the form Z!°S, (5.7) with 
f(, 0) = 0 and seek control strategies such that x* = 0 is an isolated and locally 
asymptotically stabilized equilibrium point. 

We start with a few local necessary conditions for local asymptotic stabilization 
by means of continuous control laws. In particular, we look at Brockett’s (degree) 
condition, Zabczyk’s (index) condition and Coron’s (homological) condition. 

Consider some non-surjective map g : X — Y, as there must be a point y € Y 
such that g~!(y) = Ø, y is a regular value and deg(g) = 0 cf. Sect. 3.5. Now, by 
Example 3.4 we know that isolated asymptotically stable equilibrium points have 
non-zero index (— 1)”. Then, it follows from Lemma 3.3 and Example 3.2 that (in 
the Euclidean case) indo(X) Æ 0 implies that the vector field X is locally surjective 
around 0. The reason being that one can homotope X(p)/||X(p)|l2 to (X(p) — 
D’)/\|X(p) — p’||2 for sufficiently small p’, preserving the degree and hence X (p) = 
p’ must have a solution for any sufficiently small p’. See also [131, Lemma 3]. 
Therefore, considering the control system pee the map f : R” x R” > R” must 
at least be locally surjective from a neighbourhood of (0, 0) onto a neighbourhood 
of 0 to allow for a non-zero vector field index. Note that this is a necessary but not 
sufficient condition for the degree to be non-zero. 

Given these observations, Brockett’s celebrated necessary condition follows. 


Theorem 6.1 (Brockett’s condition [18, Theorem 1.(iii)]) Let 25, be a local con- 
tinuous control system. Then, there is a continuous feedback x +> u(x) € R” with 
u(0) = 0 rendering 0 € R” locally asymptotically stable only if (x, u) œ> f(x, u) 


is a surjective map from a neighbourhood of (0, 0) onto a neighbourhood of 0. 


Proof (Sketch) When the control system is smooth, assume to have knowledge of 
a smooth controller jz with u (0) = 0 such that f(x, u(x)) is asymptotically stable. 
For indo(f) 4 0 we clearly need x > f(x, u(x)) to be surjective. 


See the proof of Theorem 6.2 for more on the purely continuous case, or see, [18, 116, 
Theorem 22]. In particular, after Zabczyk [131], Orsi et al. generalized Theorem 6.1 
to the setting where the continuous vector field does not necessarily give rise to a 
(local) flow [95]. See also [12, Theorem 4] for a generalization to nonholonomic 
control systems. A composition operator theoretic study of feedback stabilization 
is undertaken by Christopherson, Mordukhovich and Jafari in [31]. Importantly, 
by building upon Hautus, Brockett and Zabczyk, their work goes beyond necessary 
conditions and towards sufficient conditions for asymptotic stabilization. See also that 
a bijective reparametrization of the input does not change the theorem qualitatively. 
As indicated in [18], the surprising element of Theorem 6.1 is that controllability 
does not seem to play a key role when it comes to sufficiency. Indeed, one can find 
examples of systems that are controllable, yet, not asymptotically stabilizable by a 
continuous feedback law. 


5 The original result was stated for C! maps, with subsequent relaxations in [95, 131]. 
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Example 6.1 (The nonholonomic integrator) Consider the control system on R? 
defined by 

x1 =U] 

Xo =U (6.1) 


X3 =X2U1 — X1u2, 


also referred to as the “Heisenberg system” [11, Sect. 1.8]. Regarding the equilibrium 
x* = 0 € R? under u* = 0 € R’, although the linearization of (6.1) around (0, 0) € 
R? x R? does not provide a controllable linear system, the system—conveniently 
written as x = gi(x)uy + go(x)u2—is (globally) controllable as 
span {g1, 22, [g1, g2]} = R? and (6.1) is drift-free [94, Chap. 3]). Here, [-, -] denotes 
the Lie bracket [78]. Nevertheless, (x, u) œ> gı (x)uı + g2(x)uz is not surjective as 
one cannot map to (0, 0, £) for any £ Æ 0. See [2, Sect. 4] for a class of controllable 
systems that cannot be stabilized by smooth feedback and see [11, 19] for further 
generalizations of this example. 


Observe that in Example 6.1 the topological obstruction is implicit in the dynamics, 
one cannot move freely in R°. Or as put by for example Sontag in [117], the nonholo- 
nomic system imposes “virtual obstacles”. The fact that the linearization of (6.1) is 
not informative is inherent to nonholonomic systems. See [65, 123] for a principled 
methodology to obtain informative approximations using sub-Riemannian geometry. 
In fact, this viewpoint was exploited in the early work by Brockett on (6.1), cf. [17]. 

Moreover, note that Brockett’s condition prevails when one allows for dynamic 
feedback. Also note that Brockett’s condition essentially provides a necessary (but not 
sufficient) condition for indọ( f) 4 0, while we know more. This leads to Zabczyk’s 
index condition, where effectively one adapts Example 3.4 to the C° setting. 


Theorem 6.2 (Zabczyk’s index condition [131]) Let pia be a local continuous 
control system. If a continuous feedback x +> u(x) € R” with u(0) = 0 renders 
0 € R” locally asymptotically stable, then, the vector field index of x œ> f(x, u(x)) 
equals (—1)". 


Proof For flows this follows directly from Example 3.4. Momentarily ignoring com- 
pleteness, due to asymptotic stability a smooth Lyapunov function must exist [49, 
74, 126]. Following [34, p. 291], let V be a smooth Lyapunov function defined on 
some open ball B} (0) around 0. By construction one has (3+ V (x), f(x, u(x))} < 0 
for all x € B} (0) \ {0}. Hence, 0,V(x) Æ 0 for all x € B% (0) \ {0}. In fact, V is 
Lyapunov function for x = — 9, V (x), hence indo(—3x V) = (—1)”. Now we con- 
struct the map H(s, x) = —sd,V(x) + (1 — s) f (x, u(x)), which is a vector field 
homotopy since (H (s, x), 0,V(x)) < Oforalls € [0, 1] andx € B?(O) \ {0}. Hence, 
indo( f) = indg(—d,V) = (—1)". 


Observe that the homotopy constructed in the proof above preserves stability along 
the homotopy since (H (s, x), 0,V(x)) < 0 for all s € [0, 1]. In other words, f can 
be transformed into the negated gradient flow — 3x V = —VV through qualitatively 
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Fig. 6.2 Given a nominal 
vector field f’ with 

indo(f’) = (—1)". Then all 
vector fields f that are 
point-wise contained in 
blunt, (salient) convex cones, 
containing f’, have the same 
index as f’ 


equivalent dynamical systems. Understanding when this can be done is of indepen- 
dent interest and has been studied in the context of gradient flows [104], locally [32, 
Chap. 9] and under convexity assumptions [67]. See Sect. 8 for open questions. 

Although Zabczyk’s condition is stronger than Brockett’s condition, it is not nec- 
essary for dynamic feedback in the sense that the “non-lifted” dynamical control 
system x = f(x, u) might fail to satisfy the index condition while a stabilizing 
dynamic feedback exists [35]. The intuition is that the auxiliary state representing 
the input does not need to converge to 0 in an asymptotically stabilized manner. A 
secondary contribution of Zabczyk’s work was to streamline arguments via bringing 
the work due Krasnosel’skii and Zabreiko to the attention, e.g., [73, Theorem 52.1]. 
An extension to constrained (unilateral) dynamical systems is presented in [51]. Now 
recall Example 3.2, then geometrically, Theorem 6.2 states that one needs to be able 
to find a continuous map u such that the closed-loop vector field f “points in the 
direction” of a vector field f’ with indo(f’) = (—1)”. This is visualized in Fig. 6.2. 
Note, outward pointing cones would also work here as (1)"=? = (-1)"*”. 

Zabczyk’s condition is unfortunately not necessarily easy to check. Then, Coron’s 
homological index condition captures the fact that the index should be +1 via a con- 
dition on the vector field f, whose proof follows from the homological interpretation 
of the degree as sketched in Sect. 4.1, see also [59, Sect. 2.2]. Here we recall that f, 
denotes the induced homomorphism. 


Theorem 6.3 (Coron’s condition [33, Theorem 2]) Let = be a local continu- 
ous control system with n > 2 and m > 1. Assume that f is continuous over some 
neighbourhood Q of (0,0) € R" x R” and define Q, = {(x,u) E Q: f(x, u) Æ 
0, |lx|| < £, |lul| < €} with € € Roo U {+00}. If there is a continuous feedback 
x |> u(x) € R” with (0) = O rendering 0 € R” locally asymptotically stable, then, 
for any £ € Rao U {+00} 


fen- (Q; Z)) = Hy—1(R" \ {0}; 2) (S 2). (6.2) 
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Proof (Sketch) Assume that there is a continuous feedback rendering 0 locally 
asymptotically stable, say u, with (0) = 0. By continuity, there must be a suf- 
ficiently small 6 > O such that for all x € cl BS (0) \ {0} one has (x, u(x)) € Qe. 


cl B%(0) \ {0} —=— R” \ {0} 
p 


Qs 


Let g(x) = f(x, u(x)) and v(x) = (x, u(x)), then, the diagram above commutes. 
The map g represents the closed-loop vector field and as such, the vector field index 
of g, with respect to 0, over a sufficiently small open neighbourhood U of 0, must be 
(—1)”. Differently put, we know that for sufficiently small ô, g is vector field homo- 
topic to —id on cl B5 (0) \ {0}, see either Example 3.4, [34, Proof of Theorem 11.4] 
or [116, Proof of Theorem 22]. Indeed, one can also first homotope to a smooth vec- 
tor field if desired, e.g., to — V V . Now, recall (4.2), as H,—1 (cl B5 (0) \ {0}; Z) > Z, 
the induced homomorphism g, simply becomes 


8x(Hy—1 (c1 Bs (0) \ {0}; Z)) = An—1(R" \ {0}; 2) (~ Z). 


Then the result follows by commutativity of the diagram, in particular the composi- 
tional property of the induced homomorphism(s). 


As highlighted in the proof sketch above, the condition n > 2 relates to the same 
condition in (4.2) (Ho(S°; Z) % Z). Indeed, it suffices again to find an admissi- 
ble continuous feedback law such that x > f(x, w(x)) has a (—1)” vector field 
index, cf. Theorem 6.2. Here, one must also check controllability or better yet sta- 
bilizability, otherwise see that x = x and x = —x both satisfy the aforementioned 
conditions (index +1), yet, the two systems have opposite qualitative properties. On 
R” both systems even have index 1 = (—1)”. See [34, Exercise 11.7] for a typi- 
cal example that satisfies Brockett’s condition but fails to satisfy Coron’s condition. 
As will be discussed in Sect. 7.2, time-varying feedback is frequently a solution. 
Generalizations of the index condition for homogeneous stabilization are presented 
in [114]. 

Surprisingly, Brockett’s condition even prevails when certain forms of discontin- 
uous feedback are allowed, as shown by Ryan [107]. Coron and Rosier showed a 
similar obstruction by concurrently linking the existence of a stabilizing discontin- 
uous feedback to that of a stabilizing time-varying feedback [37], [36, Remark 7]. 
Discussing these obstructions in detail is outside the scope of this work as one 
needs to specify what a solution to a discontinuous differential equation (inclu- 
sion) means. Moreover, Ceragioli showed that this specification itself influences the 
obstructions [28]. 


Remark 6.1 (Robustness/fragility) Consider for some € > 0 the following pertur- 
bation of (6.1) 

x1 =u, 

x2 =u? (6.3) 


x3 =E€X, + X24] — X1U2. 
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Fig. 6.3 Remark 6.1, (i): (6.4a) versus (ii): (6.4b) for € = 1 


In contrast to (6.1), the linearization of this system, around (0, 0) € R? x R?, is con- 
trollable from the origin for any € > 0. Yet, after linearizing (6.3) in a neighbourhood 
of (0, 0), one finds that the smallest singular value of 


0 00/1 0 
0 00/0 1 : 
€— u uy O| x2 —x1 


subject to uj = u2 = 0, is proportional to €. Similarly, consider the Artstein circles 


[i =x? — x? 


6.4a 

X2 =2x 1x2 ( ) 
Here, 0 € R? is globally attractive (if considered on S*), but not globally asymptot- 
ically stable and indeed, the corresponding vector field index is 2, as in Fig. 3.4(iv). 
Again, we perturb the system, this time such that 0 is locally asymptotically stable 


for any € > 0: 


x) =— ex, +x? — x 
| i P (6.4b) 
X2 = — €X2 + 2X1 X2, 


see Fig. 6.3. Computing the linearization for (6.4b), one obtains the following matrix 
representation of the linear map 


2xı— € —2x2 
2x2 2x e€’ 


Therefore, around 0 € R?, the €-perturbation turned 0 into a hyperbolic equilibrium 
point. Yet, in a neighbourhood around 0, the smallest singular (eigen) values are 
proportional to €. 
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These examples relate to the fact that hyperbolic equilibrium points are generic 
and have a vector field index of +1. Similarly, recall Thom’s transversality theorem 
(Theorem 3.1) and consider the genericity of smooth maps f : R” x R” —> R” such 
that f h {0}. As such, applying the aforementioned conditions to models obtained, 
for example, numerically, requires great care. 


Also, the original version of Theorem 6.1 [18, Theorem 1.(iii)] by Brockett was 
stated under a C! assumption. Although we only present the third condition, the 
first condition of [18, Theorem 1] further illuminates the interest in continuous feed- 
back laws. Specifically, this condition states that the linearized system must not have 
unstable uncontrollable modes, not to obstruct the existence of a differentiable feed- 
back cf. the Hartman—Grobman theorem [106, Chap. 5]. This condition, however, 
does not rule out the existence of continuous feedback laws, e.g., in [103] Qian and 
Lin exploit homogeneity and a cascadic structure to construct continuous controllers 
for systems that might not admit a smooth controller. See also the earlier work by 
Aeyels [2], Kawski [70] and Dayawansa, Martin and Knowles [40]. 


Example 6.2 (Smooth versus continuous feedback) Consider [69, Example 2], that 
is, the control system on R? defined by 

ži =4x, + ux? 

| Im ee (6.5) 


Xy =xX2 + u, 


with u € R. The control system can be shown to be controllable, yet, no smooth, 
asymptotically stabilizing feedback x +> u(x) € R exists as the differential of (6.5) 
around 0 will have an unstable mode. However, (6.5) does satisfy Brockett’s condition 
and also Coron’s condition. After a feedback transformation, a non-differentiable 
change of coordinates and a reparametrization of time, (6.5) becomes 


z 3 
Z1 =Z1 — Zo 
. (6.6) 
i =v, 


for the new input term v € R. Then, the results due to Kawski provide for an explicit 
continuous stabilizing feedback [70] for the control system (6.6). 


6.1.2 Global Obstructions 


Now we have the machinery to present the first illustrative global topological obstruc- 
tion with respect to the domain of attraction. 


Theorem 6.4 (Sontag’s condition [116, Theorem 21]) Let p* be a locally asymp- 
totically stable equilibrium point of X € X°(M). Then, the set D(x, p*) as given 
by (5.3) is open and contractible to p*. 
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Proof (Sketch) Openness follows from continuity of pẹ. Regarding the contractibil- 
ity, the natural candidate for the homotopy would be the flow with time being 
rescaled from Rs» to [0, 1], i.e., H(t, p) = ọx(t/(1 — t), p) with t e [0, 1) and 
a well-defined limit. For the full proof see [116, Theorem 21] or the remarks below 
Theorem 6.12. 


Theorem 6.4 indicates that when M is not contractible, there is no p* € M that 
happens to be globally asymptotically stable under the flow of some complete vector 
field X € X” (M). Indeed, R” is contractible and global asymptotic stabilization of 
an equilibrium is not immediately obstructed on such a space. It is instrumental to 
remark that asymptotic stability is exploited in Theorem 6.4. Moreover, we like to 
recall an example due to Takens [119, p. 231], responding to a question of Thom, 
showing that there is a (polynomial) gradient vector field X such that the topology of 
the set T = {p € M : lim; Px (x) = p*}, for some equilibrium point p* € M, is 
not necessarily invariant under a change of Riemannian metric (intuitively, a change 
of coordinates). Indeed, the equilibrium point considered is not asymptotically stable. 

Akin to (5.3) one defines D(x, A) for A a compact attractor, cf. Chapter 5. Early 
documented results on the topology of attractors and their domain of attraction can 
be found in [10]. For example, in the Euclidean setting, A C R” can only be a glob- 
ally asymptotically stable compact set if R” \ A is homeomorphic to R” \ {0} [10, 
Theorem V 3.6]. Moreover, if p* € R” is globally asymptotically stable under some 
flow y, then D(¢g, p*) \ {p*} is homeomorphic to R” \ {0} [10, Corollary V 3.5]. 
Also, when A is a compact attractor, we have that A necessarily consists out of finite 
components [10, Theorem V 1.22]. Now, as homotopies preserve path-connected 
components, when A C M consists out of more path-connected components than M, 
there is no continuous vector field on M with A globally asymptotically stable. Inter- 
estingly, globally asymptotically stabilizing a disconnected set cannot be achieved 
using robust hybrid feedback either [111]. Although outside the scope of this work, 
see [50] for related results in the infinite-dimensional setting. 

Theorem 6.4 immediately implies that vector fields over non-contractible spaces 
do not admit globally asymptotically stable equilibrium points. This observation 
clarifies the obstructions we recovered for the circle S! as shown in Figure 1.1. 
Moreover, as contractible spaces M are homotopy equivalent to a point they have 
(singular homological) Euler characteristic x (M) = 1, e.g., see (4.4). 


Example 6.3 (Case study Sect. 1.3: global stabilization is obstructed) As was shown 
in Example 3.5, all compact Lie groups G have x (G) = 0, hence they are not con- 
tractible and global asymptotic stabilization by means of continuous feedback is 
prohibited. See Example 6.10 for non-compact examples. 


As was the motivation for the case study, Example 6.3 is of importance in many 
dynamical systems grounded in mechanics as they can be frequently identified with 
Lie groups [5, 11, 22, 93, 113]. 
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An immediate but appealing manifestation of this line of reasoning is the result by 
Bhat and Bernstein [9]. As with Brockett’s condition, their result contradicted what 
was thought to be true at the time (second half of the twentieth century), cf. [90, 
108]. 


Theorem 6.5 (Bhat—Bernstein condition [9, Theorem 1]) Let x : M —> P? be a 
vector bundle for some smooth, compact, boundaryless, base manifold B} with b > 1, 
then, there is no continuous vector field on M with an isolated globally asymptotically 
stable equilibrium point. 


Proof We know from Lemma 3.1 that compact manifolds of the form B? are never 
contractible. From Example 3.1 we know that B? is a deformation retract of M so that 
M itself can also not be contractible by homotopy equivalence. Then, an application 
of Theorem 6.4 concludes the proof. 


The compactness of the base manifold can be relaxed to not being contractible and 
the vector bundle can be generalized to a fiber bundle. Theorem 6.5 is especially 
of use in second order dynamical systems, e.g., Lagrangian systems in robotics 
are frequently defined over compact manifolds [93]. Theorem 6.5 clearly obstructs 
dynamic feedback,’ and as was shown by Bernuau, Perruquetti and Moulay, also 
uniform stabilization by means of time-varying feedback [8]. 


Example 6.4 (Obstruction to time-varying stabilization [8]) Theorem 6.5 obstructs 
the existence of continuous dynamic feedback to globally asymptotically stabilize 
an isolated equilibrium point over a fiber bundle. The reason being that in the case of 
dynamic feedback, the augmented system is usually rendered asymptotically stable 
as a whole, e.g., when employing an observer. Now if we consider time-varying feed- 
back e.g., $ = 1, x = f(x, a(s, x)), then, any solution will have its last component 
diverge to +00 for t — +00, hence the previous argument breaks down. To study 
the situation we need to define partial stability. Let N = S x M be a smooth product 
manifold and let X = (Xs, Xp) be a forward complete continuous vector field on 
N, giving rise to the semiflow @¢x, that is, the domain of dy is Ryo x N instead of 
R x N, and let m be the projection from N onto M. Note that X, : S x M > TS 
captures more time-varying schemes than simply $ = 1. Now, the point x. € M is 
said to be a partial equilibrium of X when X ,(s, Xo.) = 0 for all s € S. Then, x% 
is partially stable uniformly in s when for any neighbourhood U; C M of xa there 
is a neighbourhood Us € M of xə such that for all x € Us and for all s € S one has 
T2 o bx (t, (s, x)) € Ue for all t > 0. Now xæ is partially globally asymptotically 
stable uniformly in s when it is partially stable uniformly in s and for all (s, x) € N 


6 Here, one should assume that the fiber bundle admits a ( global) section for the statement not to be 
vacuous, e.g., by having contractible fibers. For the prototypical counter example remove Zy (S?) 
from TS? or let S! —> C be the base manifold with the fiber Z) = Z/2Z, i.e., one has the map 
m : S! — S! defined by x :z > z?. However, the map ø : z+ z!/? fails to be continuous on 
S! > C. 

7 Theorem 6.5 boils down to stabilizing feedback being obstructed due to M not being contractible. 
A common approach to dynamic feedback would enlarge the state space, e.g., to M x U, which can 
never be contractible if M is not. 
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one has m 0 x(t, (s, x)) > Xæ for t > +00. Regarding partial global asymp- 
totic stability uniform in s, consider for example x = —xs, $ = 1. To continue, let 
x : M —> Q be a vector bundle with Q a C compact base manifold without bound- 
ary and assume that a stabilizing time-varying feedback does exist, that is, there is 
a continuous vector field X = (Xs, Xp) over N = S x M with some point x. € M 
being partially globally asymptotically stable uniformly in s. Let qœ = 7 (xə) and 
define o (q) = (s', o'(q)) for some section o’ € T°(M) and some s’ € S. It follows 
that o is a section of 7 o m2 : N > Q. By assumption, X gives rise to a semiflow 
ox, then consider the map H : [0, 1] x Q > Q defined by 


Tom 0 by (log (1/1 -A)),o(4)) ifa #1 
A, gr : 
doo ifA=1. 


Indeed, H(0, 4) = q and H(1, q4) = doo. However, as one can show that H is con- 
tinuous, this homotopy contradicts Q being closed. Therefore, such a time-varying 
feedback cannot exist. Again, one can generalize the construction to fiber bundles 
under the assumption that a continuous section exists. All details can be found in [8] 
and see for instance [34, Sect. 11.2] for more on time-varying stabilization. 


Furthermore, as mentioned in [9], Theorem 6.5 can be applicable to non-compact 
configuration spaces, as long as M can be written as a (vector) bundle, e.g., let Q? be 
compact with a trivial tangent bundle, like S!, then the configuration space Q4 x R? 
leads to M = T (Q1 x R?) ~ Q1 x RIP, 

One of the objectives of this work is to clarify to what extent Theorem 6.5 prevails 
when the global stability condition is relaxed to local multistability conditions, or 
when we look beyond the stabilization of points. As such, we first consider a variety 
of necessary conditions which indicate if a (compact) manifold admits a continu- 
ous vector field with all of its zeroes being isolated locally asymptotically stable 
equilibrium points. 


Theorem 6.6 (A global necessary condition for local stability) Let M” be a smooth, 
compact, boundaryless, finite-dimensional manifold. Then, M” admits a continuous 
vector field X € X'=°(M") with z € Ns» zeroes, all of which are isolated and locally 
asymptotically stable, if and only if x (M") = z. 


Proof See that the special case of z = 0 is handled by Proposition 3.6. Then, first 
for the “only if” direction. Consider the case z > 0, as the index of these locally 
asymptotically stable equilibrium points is (—1)” (see Example 3.4), we see that 
x (M") must equal z(— 1)”. By Theorem 6.8, this cannot be true for odd-dimensional 
manifolds. Therefore, a necessary condition for local asymptotic multistability is 
that x (M”) = z. For the “if” direction one can follow the same line of arguments 
as used to show Proposition 3.6, e.g., see [54, pp. 141-148]. The difference being 
that now one starts, in local coordinates, from a set of locally asymptotically stable 
equilibrium points such that sum of their indices equals x (M"). The equilibrium 
points that emerge when these local vector fields are patched together on M” are 
removed precisely as in a general proof of Proposition 3.6. 
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Theorem 6.6 generalizes [91, Theorem 25] and the necessary direction can also 
be shown along the lines of [72] or [87, Chap. 15], see also [109, Example 17]. 

The next example clarifies how compact manifolds M with x(M) = 1 do not 
contradict the theory, global asymptotic stability remains obstructed. 


Example 6.5 (Grassmannian manifolds) Let Gr(k,n) denote the set of 
k-dimensional subspaces of R” , which is a smooth, compact, boundaryless, k(n — k)- 
dimensional, non-orientable manifold [1, Sect. 3.4.4]. These Grassmannian mani- 
folds appear frequently in the context of manifold optimization [1, 14]. Interest- 
ingly, one can compute that x (Gr(2, 3)) = 1, e.g., by considering the normal to a 
subspace one can identify (~,) Gr(2, 3) with the real projective plane RP”, defined 
as RP? = (R? \ {0})/ ~ with p ~ Ap for any A € R \ {0}, and consider a 2-sheeted 
covering of RP? by S?.® Indeed, this implies that there is a vector field on Gr(2, 3) 
with a single locally asymptotically stable equilibrium point. However, as Gr(2, 3) 
is compact, it is not contractible, hence the point cannot be globally asymptotically 
er or most of Chap. 3 would be contradicted. Indeed, again identify Gr(2, 3) with 
RP? = S?/ ~, for p ~ q when p = —q. Then consider the vector field as displayed 
in Fig. 6.4 and observe the periodic orbit on the equator. The resulting vector field on 
RP”, or Gr(2, 3) for that matter, will have a non-trivial limit set.? This observation 
is further discussed in Sect. 8.4. 


The previous example is of mathematical interest, but interestingly, the human 
eye (gazing) can be modelled as a control system on a space diffeomorphic to RP* 
[101]. Then, with respect to Example 6.5, we leave it to the reader to infer potential 
physical ramifications, e.g., does the non-trivial (@)-limit set relate to nystagmus 
(unintentional oscillatory movement of the eye)? 

In line with the work on almost global stability, Theorem 6.6 provides motiva- 
tion for abandoning local asymptotic multistability as many spaces have their Euler 
characteristic being equal to 0. A straightforward necessary conditions follows. 


Corollary 6.1 (A necessary condition for local asymptotic multistability) Any, 
smooth, compact, boundaryless, finite-dimensional manifold M admits a continuous 
vector field X € X'=°(M) with all of its z € N~o zeroes being locally asymptotically 
stable isolated equilibrium points only if x (M) > 0. 


8 Returning to Chap. 3, we remark how the Poincaré—Hopf theorem remains true when the underlying 
manifold is not orientable. Given two smooth manifolds M’ and M, a map x’ : M’ —> Mis called a 
smooth covering when 7’ is a smooth surjective map and for each p € M there is neighbourhood U 
of p such that each component of x! —!(Y) is mapped diffeomorphically onto U [78, p. 91]. Now, 
define the manifold M = {(p, Op} : p € M, O, an orientation on T,M}. and the map 7 : M —> M 
by 7(p, Op) = p. Such a map is called the orientation covering of M. Let 7 : M —> M be such an 
orientation covering. Then, if M is a connected smooth non-orientable manifold, M is a connected 
smooth oriented manifold and 7 is a two-sheeted covering [78, pp. 392-396]. This also motivates 
the mod two construction. It follows that if N is a k-sheeted cover of M, then, x (N) = kx (M). Now, 
given a vector field X on M, using 7 : M —> M, pull X back to a vector field on M, which can be 
done as 7 is a component-wise diffeomorphism, then, apply the Poincaré—Hopf theorem and divide 
by 2. 

9 As RP? does not embed in R3, this can, however, not be easily correctly visualized. 
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P3 


Fig. 6.4 In line with x (S?) = 2 and Theorem 6.6, a vector field on S? with two isolated locally 
asymptotically stable equilibrium points (py, p>) and an unstable periodic orbit O. This vector field 
also exemplifies the Poincaré—Bendixson theorem, locally, e.g., see [98, Theorem 1.8] 


As for manifolds like any odd-sphere S?”+!, the n-torus and any Lie group, 
x(M) = 0. Hence, for many spaces, local asymptotic multistability is impossible. 
Regarding a negative Euler characteristic, recall that closed orientable surfaces M? 
with genus g have x (M?) = 2 — 2g. 


Remark 6.2 (Theorem 6.4 compared with Theorem 6.6) Consider any even n-sphere 
like S*, using Sontag’s condition one concludes that continuous global asymptotic 
stability is impossible on such a topological manifold. Relaxing the adjective global, 
Fig.6.4 shows a locally asymptotically multistable vector field on precisely S?. 
Indeed, the necessary condition from Theorem 6.6 holds true as for this example 
x (S?) = 2, which equals the number of isolated equilibrium points. Note that in the 
case of Fig. 6.4, the equator functions as an unstable equilibrium point, but by means 
of an unstable periodic orbit, not a point. Nevertheless, as most relevant compact 
manifolds M have x (M) = 0, Theorem 6.4 extends to multistability in the sense that 
for most compact manifolds local asymptotic multistability is prohibited. 


Example 6.6 (Opinion dynamics) In [6], the authors study opinion dynamics on 
the compact manifolds S', S? and T? with the purpose of understanding how the 
underlying state space influences the formation of opinions. Omitting a few details, 
the authors consider 


d 
qu) = ELi aij Y (d(x: (t), x; (t))) vij (6.7) 
for x = (x1, X2,..., XN) € x^ M = (M)™ denoting the set of opinions, aij € Rthe 


interaction coefficients, Y : R — R the interaction potential with Y (0) = 0,d : M x 
M — Rso a (Riemannian) distance on M and v;; € T,,M the direction of influence. 
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Assume that Y is selected such that the right-hand-side of (6.7) is continuous. As 
expected, the consensus setting x} = x2 = --- = xy is a set of equilibrium points: the 
consensus manifold, denoted C = {x € (M)% : x; = x2 =--- = x}. Is consensus 
the the only equilibrium and is such an opinion stable? As x((M)™) = N - x(M), 
manifolds like S* cannot only have consensus as equilibria. In fact, the upcoming 
obstructions to submanifold stabiliztion will indicate that on compact manifolds 
consensus is never a globally asymptotically stable stationary opinion when M is not 
contractible. 


Example 6.6 exemplifies the benefit of the topological approach, we can arrive at 
strong insights without any explicit study of (6.7). 

Summarizing the above, global asymptotically stable equilibrium points are rare 
to encounter on nonlinear spaces. Indeed, in practice, global notions of stability rely 
on for instance exploiting model structure, optimality conditions and the existence of 
Lyapunov-like functions, e.g., in [124], the authors consider Jurdjevic—-Quinn type 
systems. Chap. 7 presents more methods towards (almost) global stability. 


6.1.3 A Local Odd-Number Obstruction to Multistabilization 


In this section multistability is considered locally. In particular, the results are in the 
spirit of the work by Ortega [96] and closely related to the odd-number limitation 
in delayed feedback, which we briefly introduce below. To aid the exposition, we 
momentarily deviate from the continuous-time system (5.1) and start with a linear 
discrete-time system. 

Following [129] we introduce the so-called odd-number limitation, which nat- 
urally appears in the context of delayed feedback control, as pioneered by Pyra- 
gas [102]. Consider a deterministic linear time-invariant system 


Xk+1 =Ax~ + Bug, (68) 
Yk =C xk, l 


with x € R” representing again the state, u € R” the input and y € R? the output (the 
observables), for some real matrices A, B and C of appropriate size. Now assume 
we want to control (6.8) using the delayed linear feedback ug = K (yk — ye-1) for 
some matrix K, as is one of the key methods in the control of periodic orbits. The 
resulting closed-loop system can be written as 


Zep = (A! + B'KC')zk (6.9) 


Pa AO 1 B nS _ _ | Xk 
s-ko) r-i] ese- a-f] 


for 
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Let P : C > C be the characteristic polynomial of the closed-loop system defined 
by P(A) = det(Al, — A’ — B’KC’) with 4 = a + ib, then, for (6.9) to be asymp- 
totically stable, we need'° P(A) Æ 0 for all |A| > 1. As A’ is even-dimensional 
limg-++o0 P (la| + i0) = +00 irrespective of our definition of P(A) i.e., det(Al, — 
(-)) versus det((-) — à In). Then, asymptotic stability of (6.9) together with continuity 
of the determinant implies that P(1 + i0) > 0. This implies, by exploiting the block 
structure!! of the problem, that det(/,, — A) > 0 must hold for (6.9) to be asymptoti- 
cally stable. Hence we observe—independent of the choice of K—a manifestation of 
the odd-number limitation, that is, unstable eigenvalues with 4;(A) > 1 must come 
in pairs to allow for stabilization. 

For more on this phenomenon, see [3, 62]. The odd-number limitation extends to 
more involved settings, and as recently shown, to hyperbolic equilibrium points [42]. 
Next, we go back to the continuous-time setting and highlight an obstruction to Pyra- 
gas control, e.g., stabilization of t-periodic orbits by means of t-delayed feedback. 


Theorem 6.7 (De Wolff and Schneider [42, Corollary 3]) Consider the differen- 
tiable control system x(t) = f (x(t)) + u over R” and suppose that p* € R” is a 
non-degenerate equilibrium of f. Moreover, assume that Df,» has an odd number 
of eigenvalues (counting algebraic multiplicities) in the strict right half (complex) 
plane. Then, for all K € R"*" and all t > 0, p* is unstable as a solution of the 
controlled system x(t) = f (x(t)) + K[x(@t) — x(t — T)]. 


In the setting of compact manifolds, Theorem 6.7 extends, under more general 
types of feedback. This condition is useful in situations where y (M) is unavailable 
and/or one has no knowledge of the number of equilibrium points of X € X” (M), 
but one does have some local information. 


Theorem 6.8 (Odd-number obstruction to local asymptotic multistabilization) Let 
X € X7=9(M") be an uncontrolled vector field on a smooth, compact, boundary- 
less manifold M" with all its zeros being isolated hyperbolic equilibrium points 
{Pi -- -> Pin} # Ø. Given any control system © = (M", U, F) in the sense of Def- 
inition 5.5, then, the set {p*}icr can be locally asymptotically stabilized by con- 
tinuous feedback u : M” — U, without introducing new equilibrium points, only if 
dim(W“ (ox, p7)) is even for alli € I. 


Proof Without loss of generality, we will consider some Z #0 and an even- 
dimensional manifold as the odd case cannot be handled regardless, e.g., recall 
Corollary 4.1. If dim(W" (gx, p7)) is odd, then ind,» (X) = —1 and as such, by the 
Poincaré—Hopf theorem (Corollary 3.1) and the hyperbolic index results from [73, 
Secti. 6], |Z| Æ x(M"). Hence, by Theorem 6.6, this set cannot be locally asymptot- 
ically stabilized by means of continuous state-feedback. 


10 Asymptotic stability of linear discrete-time systems of the form xz, = Ax, is captured by 
p(A) < 1, for (A) the spectral radius of A. Such a A is also said to be Schur stable. 


l1 Let some square matrix D be invertible, then a useful decomposition for appropriately sized 


-1 _ -1 
square matrices A, B, C is the following l | = p E | i a C J se i 
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Instead of demanding that dim(W“ (x, p¥)) is not odd, one could equivalently 
demand that, in coordinates, the differential of the uncontrolled vector field X sat- 
isfies DX y € GL* (n, R) for alli € J. As the orientation of a map is a topological 
invariant [77, Chap. 6], this implies that the statement of Theorem 6.8 is topo- 
logically invariant, as it should be. For example, let a* and b* correspond to two 
hyperbolic equilibrium points of some vector fields X and Y, respectively, with 
the dynamics around those equilibria locally captured by x = Ax and y = By for 
a* and b*, respectively. Then, since GL(n, R) = GL*(n, R) u GL (n, R) only if 
the maps f(x) = Ax and g(y) = By have the same orientation, there is a homotopy 
H(s, z) = C(s)z such that H (0, x) = Ax and H(1, y) = By with z = C(s)z hyper- 
bolic for alls € [0, 1] [106]. Better yet, let A € R”*” correspond to an asymptotically 
stable linear system, i.e., indg(Ax) = (—1)” then for indo(By), with B € R”*”, to 
be (—1)”, one needs the unstable eigenspace of B to be of even dimension. In other 
words, the even dimension is necessary for local analysis. This is not an overly 
strong condition as spirals and second order systems are naturally of even dimen- 
sion, see also the discussions in [42]. Note that although GLt (n, R) isa subgroup of 
GL(n, R), it is not necessary in general to preserve the group structure as (locally) 
asymptotically stable systems are not necessarily hyperbolic, e.g., consider ž = —x?. 
Example 6.7 (Rayleigh quotient on the sphere) Consider a smooth function £ : 
S’-'! c R” > R defined by £: pr 5(Ap, p) for some symmetric matrix A € 
Sym(n, R) and (-, -) the Euclidean inner-product. One might be interested in either 
minimizing or maximizing £ over S"~!. By means of this function we will study gra- 
dient flows on S’~! C R” and exemplify previously discussed material. When one 
views S"~! as a Riemannian submanifold of R”, then grad €(p) = (A — In(Ap, p))p 
for all p € S"“! [1, Table 4.1]. 


(i) Regarding Theorem 6.6, v; € S"~! is a unit eigenvector of A if and only if v; 
is a critical point of the function £ [1, Proposition 4.6.1]. As x(S"~!) = 0 for 
n being even and x (S"~!) = 2 for n being odd, x (S"~!) Æ n for all n € No. 
Hence, by Theorem 6.6 there is no continuous vector field X € H=9(S"-1) 
such that every equilibrium point of X is isolated and locally asymptotically 
stable but also an eigenvector of A € Sym(n, R). 

(ii) To exemplify Theorem 6.8, let n = 3 and assume to be an observer of the 
gradient flow (under the Euclidean metric) grad £ (maximization) on S? c R?, 
without having knowledge of £. One can show that this flow is equivalent to 
the projection of the solution to x(t) = Ax(t) onto the sphere. Let A have 
only simple eigenpairs (v;,A;) with A; < Az < A3, it follows from [1, Propo- 
sition 4.6.2] that for a curve t > y(t)(v; + tv;)/|lvj + tvill2 with i A j one 
has 


d2 
gz tY l= =A; —A;. 


This implies that only the points +v3 € S? are locally asymptotically stable 
equilibrium points while +v; and +v are unstable. Indeed, the unstable mani- 
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fold of v2 is odd-dimensional, obstructing the possibility of global continuous 
multistabilization as set forth by Theorem 6.8. See also [60, Sect. 1.3]. 

(iii) At last, recall Brockett’s necessary condition, i.e., Theorem 6.1, and consider 
a Rayleigh-like control system on S? C R? defined by 


x= f(x,u) = (A—L(Ax,x))x+ (Bb — xx! )u (6.10) 


for some symmetric matrix A € Sym(3, R) and u € R?. As T,S? = {( — 
xxv :vE R3}, Brockett’s condition holds, locally, but we know from above 
that (continuous) local asymptotic multistability cannot hold for (6.10). Hence, 
the local condition proposed in [18] is too weak to generalize to multistable 
problems on compact manifolds (the global topology is not taken into account). 
In contrast, Theorem 6.8 catches the impossibility correctly. 


See [120, Corollary 5] for an odd-number obstruction in the context of network 
control and [30, Theorem 1] for odd-number results in the context of optimization. 
See also [115, Proposition 4.11] for a result technically in the spirit of Theorem 6.8, 
but with ramifications in the study of Anosov diffeomorphisms, i.e., diffeomorphisms 
G : M — M such that TM has a hyperbolic structure under G. 


6.2 Obstructions to the Stabilization of Submanifolds 


Consider again the nonholomic integrator (6.1). We know that the origin cannot be 
locally asymptotically stabilized by continuous feedback, but what about another 
set? If one ignores the x3 coordinate we expect to be able to stabilize sets in some 
xı — X2 plane. Indeed, simply pick u; = —x, and u2 = —x7 to locally asymptotically 
stabilize (0, 0, x3 (fo)) € R°. This intuition extends and one can for example find con- 
trollers to locally asymptotically stabilize the cylinder {x € R? : x? + x2 = 1} [82, 
p. 1], see also [89, Example 5]. As stated by Mansouri, when stabilization to a point 
fails, stabilization to a submanifold seems the next best. Submanifold stabilization 
occurs for example naturally in the context of nonholonomic control systems [12] 
and feedback linearization [64, 94]. In particular, if stabilization to a point fails, can 
one stabilize the system to a small Euclidean sphere enclosing this point? 

To start, let A be a compact, connected, oriented, codimension-1 embedded sub- 
manifold of R”, i.e., dim(A) = n — 1, and let d denote the Euclidean metric. !? Using 
ideas similar to Coron [33], Mansouri proves the following.!? Again, we recall that 
jf denotes the induced homomorphism from Chap. 4. 


Theorem 6.9 (Mansouri’s condition [82, Proposition 1]) Let goe be a local contin- 
uous control system. Assume that f is continuous over some open neighbourhood Q 


12 The distance from p € R” toa compact set A C R” is defined as d (p, A) = minaca || p — all. 


13 Here we take the recent results due to Fathi and Pageault into account [49], cf. [83, Remark 2.2]. 
See also [79]. 
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of C R” x R” and define fe = {(x, u) E Q: f(x, u) £0, d(x, A) < e}. Letx œ> 
u(x) be a continuous feedback rendering A an attractor with g(x) = f (x, u(x)) 
denoting the closed-loop. Then, one has for all e > 0 


Jf (Bn-1 (2 fe; Z)) 2 deg(g) ü Z. (6.11) 


The proof is similar to that of Theorem 6.3, we only provide intuition regarding the 
appearance of the degree. 


Proof (Sketch) Recall Chap. 5, by construction, there is smooth Lyapunov function 
V for A [49]. As A is of codimension-1, then by the Jordan—Brouwer seperation 
theorem e.g., see [61, p. 107], the levelset V~'(c), for sufficiently small c > 0, 
consists out of two components, think of A = S! c R°. Let V, denote the “outer” 
component of V~'(c) and let A; be a tubular neighbourhood of A, which exists [78, 
Theorem 6.24]. Due to asymptotic stability one can pick 6 > O such that for all 
x € As \ A one has (x, u(x)) € Q¢e, moreover, by V being proper, there is c > 0 
such that V. C As. Now one can essentially copy the commutative diagram from the 
proof of Theorem 6.3, using the same functions, that is 


Ay-1 (Ve; Z) n Ay (R” \ {0}; Z) =Z 


J» ew. 


Hn-1 (Qf, £; 2) 


Therefore we have that fa (Hn-1 (Q fe; Z)) 2 84(Hn-1(Ve; Z). Then, as V, is one 
of the two components of V~! (c), Ha—1 (Ve; Z) = Ho(V.; Z) ~ Z by Poincaré dual- 
ity. Better yet, V. is a closed, oriented manifold itself, such that deg(g) via g, is 
well-defined, e.g., recall the rationale of Lemma 4.1 and consider the following 
diagram or see [82] for the full explanation. 


Ve —= R" \ {0} 


gn-l 


In contrast to Theorem 6.3, one does not assume that (a) = 0 for alla € A. Indeed, 
assumptions of that form are not necessary, they rather (over)simplify the exposition. 

Condition (6.11) is not particularly transparent, one rarely has access to deg(g). 
However, by the assumptions on A, one can appeal to the the Gauss—Bonnet—Hopf 
(Dyck) theorem [53, 88], stating that for a closed manifold M?-! c R” the Gauss map 
y : M"! — S"~!, defined by y (p) being the unit normal at p € M, one has deg(y) = 
x (N) for N the bounded component of R” \ M’~!. In fact, this theorem relates directly 
to a manifestation of the Poincaré—Hopf theorem for manifolds with boundary and 
vector fields pointing outward cf. Sect. 8.2. Then, using the Gauss—Bonnet—Hopf 
theorem, one can relate the vector field g on the components of the levelset V~! (c) 
to inward- and outward pointing vector fields, normal to those manifolds. As such, 
this allows for linking deg(g) to the topology of A, e.g., due to a result by Hopf, 
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when n is odd, deg(g) = $x(A) [82, Theorem 4].'* Now one can show that the 
nonholonomic integrator cannot be stabilized to S? either since x (S?) = 2 while the 
left-hand-side of (6.11) evaluates to 0 [82, Corollary 2]. A similar, but not identical, 
result can be shown for A being of codimension strictly larger than 1 [83]. 

The aforementioned results on submanifolds are of a local nature and generalize 
the condition due to Coron. Using retraction theory one can provide obstructions of 
a global nature and without explicit knowledge of vector fields. 


Proposition 6.1 (Moulay and Bhat [92, Proposition 10]) Let M be a smooth mani- 
fold and A a compact, embedded submanifold of M. Then A is a strong neighbourhood 
deformation retract of M. 


Ultimately, Theorem 6.12, as discussed in the next section, states that if a set A C M 
is an attractor under a flow ¢, then A is a weak deformation retract of D(ọ, A). 
Therefore, in case A is an attractor, combining Proposition 6.1 with Lemma 2.2 
and Theorem 6.12 leads to A being a strong deformation retract of D(g, A). This 
implies in particular that A can only be a global attractor if it is a strong deformation 
retract of M. This result also appeared, with a different proof, in [130, Lemma 4]. As 
highlighted in [130], indeed, for A to be a global attractor of M, the spaces must be 
homotopy equivalent, e.g., stabilizing S! in S? fails as x (S!) = 0 while x (S?) = 2. 

Returning to Example 6.6, consider two agents with M = S! such that (M)? = T? 
and C = Agi œ, M, although x (S!) = 0 and x (T?) = 0, C and (M)? are not homo- 
topic as they have for instance different homology groups and different fundamental 
groups,!> i.e., 71 (S!) > Z and m (T3) ~ Z?. 

Proposition 6.1, however, says more, the deformation retract is of the strong type. 
For example, when M is an absolute neighbourhood retract (ANR),'® then, A being 
a deformation retract of M is equivalent to A being a strong deformation retract of 
M [63, p. 199], see also [118, p. 31]. As before, we immediately observe some form 
of an odd-number limitation. 


Corollary 6.2 (Odd-number limitation for attractors) Let M be a smooth, closed 
manifold with x(M) 4 0, then M does not admit any continuous vector field X 
such that any odd-dimensional, compact, embedded submanifold A of M is a global 
attractor under X. 


Using Propsition 6.1 and the mod 2 intersection theory from Section 3.4, Theo- 
rem 6.5 can be generalized beyond stabilization of a point. Again, this result is stated 
for simplicity using vector bundles. Generalizations to fiber bundles are possible. 


14 Informally, given a compact manifold M with ðM # Ø, glue a copy of M to M itself along 
their boundaries and call the resulting manifold M’, which is now closed. Then we have x (M’) = 
2x (M) — x (0M). As such, when M is odd-dimensional, x (M’) = 0 such that x (M) = 5x (3M). 
Formally, one employs a so-called Mayer—Vietoris sequence argument [118, Sect. 4.6]. 

15 We did not touch upon homotopy groups, the fundamental group being the first homotopy group, 
but point the reader to [77, Chap. 7] for more information. Intuitively, the fundamental group of a 
topological space X measures how many different loops, up to homotopy, the space X admits. 

16 A Hausdorff space X is normal when for any two closed subsets U, U’ C X there are open 
neighbourhoods W D U, W’ D U’ such that W’ N W = Ø. Then, a space X is an ANR when for 
any embedding in a normal space ı : X — Y, (X) is a neighbourhood retract [13]. 
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(ii) 


Fig. 6.5 Example 6.8, (i): robotic arm in R? with y the trajectory that keeps e* fixed; (ii): the 
configuration space S* x S? of the robot arm with the curves corresponding to y, which are not 
independent as indicated by the marker on the curves 


Theorem 6.10 (Obstruction to submanifold stabilization: bundles) Letz : M —> B 
be a vector bundle over some smooth, boundaryless, compact, connected manifold B 
andletA C Z,,(B) be acompact, embedded submanifold ofM. If there is a continuous 
flow ọ on M such that A is a global attractor under ọ, then, A = Z,,(B). 


Proof The case where A is a point follows from Theorem 6.5 (Lemma 3.1 and 
Theorem 6.4). Regarding the general case, as demonstrated in Example 3.1, the zero 
section Z,(B) is a deformation retract of M. If A would be a global attractor, then, 
by Lemma 2.2, Proposition 6.1 and Theorem 6.12, A would be a deformation retract 
of M as well. In its turn, this implies by Lemma 2.1 that A is a deformation retract 
of Z„ (B), which, by Lemma 3.2, cannot be true when A Æ Z,(B). 


Theorem 6.10 implies in particular that if M” is a smooth, boundaryless, compact, 
connected manifold. Then, given any compact, embedded submanifold A? —> M” 
with 0 < a < m, there is no complete vector field X € ¥'=°(M”) such that A“ is 
a global attractor. Regarding Section 1.3 (compact Lie groups), not only global 
stabilization of a point is obstructed, but effectively of any non-trivial submanifold, 
as Lie groups are boundaryless. Then, as was the motivation for [9], Theorem 6.10 
is of use in the context of mechanical systems. Recalling Example 2, a periodic orbit 
of the pendulum, as seen as a curve in TS! is clearly homotopic to S!. 


Example 6.8 (Kinematic robot control) Consider a two-link robotic arm with spher- 
ical joints. The goal is to globally stabilize the end-effector position at e* € R?, 
see Fig.6.5(i). Here we assume to work with a dynamical control system on 
M = T (S? x S°), i.e., a second-order system. As shown in Fig.6.5(i), the config- 
uration of the arm is not uniquely defined by e*, instead, one can freely move the 
elbow joint over the curve y without changing the position of e*. One might want 
to exclude this ambiguity and render the dynamical system stationary on y, while 
still globally stabilizing e*. As the motion of the two joints is not independent, the 
curve y represents a 1-dimensional set in the configuration space S? x S?, e.g., see 
Fig. 6.5(ii). Regardless, one must be able to globally continuously stabilize a curve 
homeomorphic to S! in the zero section of 7, : TS? —> S°, for an individual joint, 
say jı. This is prohibited by Theorem 6.10. 
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Fig. 6.6 Example 6.9: controlling a satellite (free rigid body) towards pointing along v, with angular 
velocity Q, that is, the orientation is not fully fixed 


Example 6.9 (Satellite control) Consider a free rigid body model of a satellite on 
M” = TSO(3, R) ~ SO(3, R) x R?, where the last identification follows as Lie 
groups are parallelizable. Let (R, Q) € SO(3, R) x IR? denote the orientation and 
angular velocity, respectively, with Q^ € so(3, R) cf. Example 5.2, then, for x the 
cross-product, an input-affine control system is given by 


R(t) =R(t) Q(t) 


Dae ae m 6.12 
me TQ(t) =[Q(t) x Q(t) + YE giui ( ) 
i=l 
for J some inertia tensor, g; € R? and u; € R available inputs fori = 1,2,...,m, 


see [25], [11, p. 37]. Fix any v € S? C R?, we want to asymptotically stabilize the 
satellite, pointing along v, see Fig. 6.6. However, we do not specify a fixed rotation 
along this axis, only a constant velocity, that is, given the maph : SO(3, R) > R?, h : 
R > (R — 1,)v we want to render A = {(R, v) € M : A(R) = 0} globally asymp- 
totically stable. Now, the set A is a 1-dimensional compact, embedded, submanifold 
of M as the set {R : A(R) = 0} is a stabilizer subgroup of SO(, R) with respect 
to v [45, p. 94], in particular, {R : A(R) = 0} is isomorphic to SO(2, R) ~ S!. As 
in [25], see that we do not demand the closed-loop vector field to vanish on A. Sucha 
task might be locally feasible [89], however, for any m, continuous global asymptotic 
stabilization is obstructed by Theorem 6.10 (possibly, after a shift Q=2-v). 


Similar topological obstructions occur for example in surgical robotics [125]. 

In [86], Mayhew and Teel extend Theorem 6.5 to the context of submanifold 
stabilization under set-valued maps. In particular, it is shown that for differential 
inclusions, i.e., vector fields of the form x € X(x), X : M = TM, satisfying the so- 
called “basic conditions” [86, Definition 5] the answer to Question (ii) is effectively 
the same as in the smooth case. The reason being that if a submanifold A C M is an 
attractor under such a—possibly discontinuous—vector field, then there must exist a 
smooth, complete vector field X’, defined on the domain of attraction of A, such that 
A is an attractor under X’ [86, Theorem 14]. Although this framework captures some 
discontinuities, their conditions, however, do not capture for example Fig. 1.1 (iii). 

We end with a remark on compactness. In [127, Theorem 3.4] it is claimed that 
the domain of attraction, for any submanifold A C M, compact or non-compact, 
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is homeomorphic to its tubular neighbourhood. This claim has been disproven and 
corrected by Lin et al. [79]. See in particular [79, Sect. 4] for counterexamples. 


6.3 Obstructions to the Stabilization of Sets 


Regarding Question (i), in 1993, Günther and Segal showed that a finite-dimensional 
compact set A can be an attractor of a continuous flow on a manifold if and only if 
A has the shape!’ of a polyhedron [55, Corollary 4]. Although the Warsaw circle 
is not homeomorphic to S! it does have the shape of S!, see [58, Example 3.3] 
for an example by Hastings, rendering the Warsaw cirlce an attractor. Regarding 
realizable compact attractors, see also the article by Ortega and Sanchez—Gabites [97] 
and references therein. To add regarding Question (iii), given a compact attractor 
A CM with domain of attraction D, already the boundary of D can be arbitrarily 
complicated, cf. [110]. 

Hence, we pass to Question (ii). As mentioned before and indicated in [11, 82], 
if stabilization of a point is prohibited, stabilization of a set might be the next thing 
to consider. Concurrently, stabilization of a point might be to simplistic. In contrast 
to the previous section we will not assume this set to have a manifold structure, see 
that a variety of results in that section exploited this structure by appealing to the 
existence of a tubular neighbourhood. 

Kvalheim and Koditschek recently generalized Brockett’s condition to stabiliza- 
tion of any compact subset A C M with x (A) Æ 0 [76]. To make sure x (A) is well- 
defined, the authors appeal to Cech—Alexander-Spanier cohomology theory [76, 
Sect. 2], which is outside the scope of this exposition, but when discussing their 
result we assume to work with this homology theory. 


Theorem 6.11 (Kvalheim—Koditschek condition [76, Theorem  3.2]) 
Let £ = (M, U, F) be a control system and let A C M be a compact attractor. 
Assume that x(A) 4 0, then, for any neighbourhood W C M of A there exists a 
neighbourhood V C TM of the zero section of TM such that for any continuous 
vector field X : W —> V 

Fa (WD A X(W) #8. (6.13) 


The motivation for Theorem 6.11 came from the development of repelling vector 
fields, i.e., to render some unsafe set U C M repelling. Equivalently, one could render 
the safe set S = M \ U attractive. After proving when x (S) is well-defined, that result 
is summarized in [76, Theorem 3.6]. This result provides a variety of answers with 
respect to [130, Conjecture 2] stating that it is impossible for vehicles to smoothly 
converge to a desired configuration from every initial configuration in an environment 
scattered with obstacles, see [76, Example 2]. See also the work by Byrnes [24] for 


17 Shape theory is outside of the scope of this work, we refer the reader to the survey articles by 
Sanchez-—Gabites [109] and Sanjurjo [112]. 


6.3 Obstructions to the Stabilization of Sets 99 


earlier generalizations of Brockett’s condition with respect to the global stabilization 
of A CR’. 

Now, recall Example 6.1. Mansouri showed that the cylinder can be rendered an 
attractor [82, p. 1]. Then, using Theorem 6.11 one can show that the topology of the 
cylinder is crucial here as no set with non-zero Euler characteristic can be stabilized. 
Interestingly, when A is a point, Theorem 6.11 can be shown to be strictly stronger 
than Brockett’s condition, while the condition turns out to be weaker than Coron’s 
condition [76, Sect. 6]. This trade-off is however a recurring one, conditions based 
on homology theory are frequently stronger, but also significantly harder to check. 

Recall the definition of a dynamical system (M, R, ¢) in the sense of Sect. 5.1. 
Then, using the retraction theory as set forth in Chap. 2, we can provide a generic 
result, a generalization of the work by Sontag [116, Theorem 21] (Theorem 6.4) and 
Bhatia and Szegö [10, Lemma V 3.2], due to Moulay and Bhat. 


Theorem 6.12 (Moulay—Bhat condition [92, Theorem 5]) Let (M,R,y) be a 
dynamical system over a topological manifold M. Let A C M be a compact attractor, 
with domain of attraction D(g, A). Then A is a weak deformation retract of D(g, A). 


Proof (Sketch) As a topological manifold is in particular a locally compact Hausdorff 
space, Theorem 5.1 applies. Now let U. = {x € D(g, A) : V(x) < c}. Note that 
U. is positively invariant, i.e., p'(U.) C Ue for all t > 0 and N..9U, = A. Hence, 
for each open neighbourhood W C M of A there is a c > 0 such that U, C W. 
Now, define T} (x) = inf{t > 0: g'(x) € Ue}, which can be shown to be continuous. 
Then, pick any W with c > 0 such that U. C W and consider the map H: I x 
D(y, A) > Dg, A) defined by H(t, x) = y (tTe(x), x), which is continuous and 
satisfies H(O, x) = x for all x € D(g, x), HU, x) € Ue for all x € Dg, A) and 
H(t,x) = x for all x € U.. Hence, H parametrizes a strong deformation retract 
from D(g, A) onto U.. As W was an arbitrary open neighbourhood of A, this shows 
that A is weak deformation retract of D(g, A). See [92] for the details. 


In combination with Lemma 2.2 one recovers for example from Theorem 6.12 that 
if A C M is a compact attractor of a dynamical system (M, R, ø), then, if A is a 
strong neighbourhood retract of M, A is a strong deformation retract of its domain 
of attraction D(g, A) [92, Corollary 7]. We emphasize that Theorem 6.12 remains 
true for M being a locally compact Hausdorff space. 


Example 6.10 (The rotation group as a potential attractor) For any A € GL* (n, R) 
let A = UP be its Polar decomposition, for some U € SO(n, R) and symmetric 
positive definite P € S?,). Then consider the map H(t, A) = U (tI, + (1 — t)P) 
for t € [0,1]. See that H(0, A) = A for all A € GLt(n,R), H(1, A) =U for 
A=UP and H(t, U) =U for all U e SO(n, R) and all t. Hence, as Ate U 
is continuous, SO(n, R) is a strong deformation retract of GL*(n, R).!8 Now for 
some B € SL(n, R), let B = QR be its QR decomposition for Q € SO(n, R) and 
R € R” being upper-triangular with strictly positive elements on its diagonal. Now 


18 See that U = A(WATA)~!. The reader is invited to visualize a slice of SO(2, R) —> GL*(2, R). 


100 6 Topological Obstructions 


define the map H(t, B) = QZ(t) witht € [0, 1] for Z(t) such that z;; (t) = ri, and 
zij(t) = trij fori A j. Then we see that H (0, B) = Q for B= OR, H(1, B) = B 
and H(t, Q) = Q for all Q € SO(n, R). Again, one can show that this decom- 
position is continuous such that SO(n, R) is also a strong deformation retract of 
SL(n, R). Note that for any n > 1, SO(n, R) cannot be a global attractor of a flow 
on R” ~ R? by Lemma 3.1. Similarly, although we can construct a trivial embed- 
ding ı : SO(n, R) —> SO(n + 1, R), by Lemma 3.2 SO(n, R) cannot be a global 
attractor in such an ambient space either. For further comments, see [21]. 


Remark 6.3 (Ona proof of Theorem6.4) Consider now A being a point, denoted p*, 
and assume that M is locally contractible, as any topological manifold. Clearly, p* is 
a strong neighbourhood retract of M. Hence, Theorem 6.4 follows as a corollary to 
Lemma 2.2 and Theorem 6.12. When M = R”, Theorem 6.12 can be strengthened 
to A being a strong deformation retract of D(g, A) [7]. 


Remark 6.4 (Stabilization of A with x(A) = 0) Whereas works like [76, 82, 83] 
can in general not address the stabilization of compact sets A C M with x (A) = 0, 
the retraction-based results provide some necessary conditions, see Theorem 6.12 
and Example 6.10. A necessary condition for global stabilization of A of the form 
x (A) = x(M) is clearly weaker than the deformation retract formulation, e.g., the 
preservation of the Euler characteristic is necessary for homotopy equivalence, but 
not sufficient. For instance, compare the homology groups of S! <> T? to that of the 
ambient space. 


Remark 6.5 (More on robustness) The retraction-based results are robust in the 
sense that they are true for any continuous control system. However, consider stabi- 
lizing the unit disk DẸĮ and the punctured unit disk DẸ \ {0} in R”. Again, arbitrarily 
small perturbations can potentially invalidate a necessary condition for continuous 
stabilization. This is important to take into account with numerical methods in mind. 


Coming back to where we started, Kvalheim recently generalized the homological 
results due to Coron and Mansouri via appealing to homotopical arguments in the 
spirit of those by Bobylev, Krasnosel’skii and Zabreiko indeed, cf. Example 3.2, 
Example 3.4 and [75]. Now, we recall Assumption 5.1 and state the first result. 


Theorem 6.13 (Kvalheim’s homotopy [75, Theorem 1]) Let M be a smooth mani- 
fold and let X, Y € X'=°(M) be such that the compact set A C M is asymptotically 
stable under both. Then, there is an open neighbourhood U of A such that X|u\a 
and Y|y\a are homotopic through non-vanishing vector fields. 


As in Example 3.4, using the flows corresponding to X and Y, locally, a homotopy 
is constructed to prove Theorem 6.13. Note that the tools from Chapter 4 now imply 
that for U as in Theorem 6.13 and any W CU \ A we have that the following 
induced homomorphisms agree (X|w)s, (Y |w) : Ho (W) > Ho (TW \ {0}). This 
observation is exploited below. 

The aforementioned results can now be unified as follows. One constructs a 
“canonical” vector field Y on an open neighbourhood U of A such that A is locally 
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asymptotically stable. For this canonical vector field Y one computes some homo- 
topy invariant of interest and by Theorem 6.13 this extends to any vector field locally 
asymptotically stabilizing A. The importance of having the vector fields to be non- 
vanishing on U \ A is displayed in for instance Example 3.4 and the proof (sketch) 
of Theorem 6.3, without this requirement we are not capturing meaningful informa- 
tion, e.g., any two continuous vector fields on R” are straight-line homotopic. 

In the setting of an equilibrium point the canonical vector field (with the origin 
being asymptotically stable) is locally given by x = —x. Indeed, from there one 
computes the corresponding index cf. Example 3.4. More general, for an embedded 
submanifold A in R”, the canonical stabilizing vector field is the negated normal 
vector field. Indeed, Mansouri exploits this and the existence of a tubular neigh- 
bourhood in [82, Theorem 4] to relate deg(g) from Theorem 6.9 to the underlying 
topology of A. In the general case, one cannot appeal to tubular neighbourhoods 
and the canonical vector field Y is less obvious to select. One usually passes to the 
dynamical system generated by the negative gradient flow of a Lyapunov function. 

It is important to stress that all of these results provide necessary, but by no means 
sufficient, conditions, e.g., consider vector fields of the form X; = X and X2 = —X. 

The same is true for the final Theorem of this chapter. Nevertheless, recall that Y, 
and F, denote induced homomorphisms and recall the notion of a control system & 
as given by Definition 5.5, then, one can use Theorem 6.13 to derive rather generic 
homological necessary conditions. 


Theorem 6.14 (Kvalheim’s condition [75, Theorem 2]) Let M be a smooth man- 
ifold and let £ = (M, U, F) be a continuous control system. Assume there is a 
Y € X"=0 (M) such that the compact subset A of M is asymptotically stable under Y. 
Moreover, assume there is a feedback n that asymptotically stabilizes A. Then, for a 
sufficiently small open neighbourhood U of A one has 


Y, Ho (U \ A) S F Horz (U \ A) \ FO) © HY (TU \ A)\ 0). (6.14) 


In the proof of Theorem 6.14, one exploits the decomposition as (F o y), = F, © Hx. 
As pointed out in [75, Remark 1], the results due to Coron and Mansouri follow indeed 
from (6.14). Again, one can find control systems that do satisfy the conditions of 
Theorem 6.14, yet, continuous asymptotic stabilization is impossible. The reader is 
invited to find non-trivial examples. See also that Theorem 6.14 does not assume 
x(A) Æ 0. In conclusion, 


(i) we see that retraction theory allows for the construction of necessary conditions 
independent of the precise continuous control & system, cf. Theorem 6.12; 

(ii) we also see that the methodology as put forth in the monograph by Kras- 
nosel’skii and Zabreiko allows for generalizations far beyond characterizing 
the continuous stabilization of equilibrium points in R”, cf. Theorem 6.14. 
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6.4 Other Obstructions 


Besides the aforementioned topological obstructions, a topological viewpoint can 
be seen to be fruitful in other modern branches of system identification and control 
theory [16, 27, 66, 68, 81]. In particular, in [20] a topological obstruction to the 
reach control problem is presented. Obstructions to simultaneous stabilization (robust 
control), are considered in [41]. Extensions of Brockett’s condition in the context 
of exponential stabilization are discussed in [56]. With respect to adaptive linear 
control, topological obstructions to self-tuning are presented by Polderman [100] 
and van Schuppen [122]. In the context of hybrid systems, Ames and Sastry present 
topological obstructions to zeno behaviour in [4]. In [84, 85], Mansouri presents 
topological obstruction to the existence of distributed controllers, that is, controllers 
where each input variable can only depend on a subset of the state variables. 

Necessary and sufficient conditions for global, smooth, feedback linearization of 
a smooth, input-affine system (5.8) with m = 1 are presented in [39], for example, 
M must be simply connected, ruling out SO(n, R) for n > 2. 

Topological obstructions also appear in the context of motion planning algorithms. 
In line with Theorem 6.4, a globally defined continuous motion planning algorithm 
exists only if the underlying configuration space is contractible. See [47, 48], for 
more work by Farber on topological obstructions to motion planning algorithms 
and [52] for early remarks by Gottlieb. Somewhat related, see [80] for obstructions 
to certain tracking problems. In particular, see [80, Example 4.1] which considers 
Brockett’s nonholonomic integrator (6.1). 

There is also a line of work by, amongst others, Byrnes, Delchamps and Hazewinkel 
on the geometry and topology of linear systems, providing for further obstructions 
to for example global system identification, e.g., see [23, 26, 43]. 

See [29, Sect. 18.5] or [105, pp. 35-36] for related phenomena in the calculus of 
variations, the so-called “Lavrentiev gap”. 

In the context of physics, in particular particle physics, topological curiosities 
manifest themselves mathematically for example via Poincaré’s lemma, e.g., the 
Ehrenberg—Siday—Aharonov—Bohm effect, and by means of the Atiyah—Singer index 
theorem, e.g., to understand spectral flows [44]. Here, the topological obstruction 
oftentimes relates to not being able to apply Stokes’ theorem, e.g., a differential 
form fails to be exact. Earlier, topological obstructions were studied in the context 
of Hamiltonian mechanics [46]. 

Topological obstructions have also been reported in chemistry, although more 
related to data analysis [57]. For infinite-dimensional problems, topological obstruc- 
tions frequently pertain to reachable sets being empty due to the fact that a compact 
set in an infinite-dimensional Banach space has empty interior, e.g., see [15]. Topo- 
logical obstructions in the context of neural networks are alluded to in [128]. 

The topological viewpoint also provided to be useful early on in the context of 
Bellman equations [121], e.g., see the initial work by Petrov on regularity in the 
context of time-optimal processes [99]. 
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Chapter 7 A) 
Towards Accepting and Overcoming get 
Topological Obstructions 


Obstruction results are aided by the generality offered by the topological viewpoint. 
Constructive results, however, oftentimes require more structure of the problem to 
be available [12], e.g., in 1983, Artstein [5] and Sontag [52] introduced CLFs; using 
center manifold theory, Aeyels was one of the first to provide constructive argu- 
ments towards smooth stabilization of nonlinear systems [1]; feedback linearization 
emerged in the late 1980s, as can be found in the monographs [27, 40]; and in the 
late 1980s backstepping was initiated by Byrnes, Isidori, Kokotovi¢, Tsinias, Saberi, 
Sontag, Sussmann and others [31]. See also the 1985 and the 2001 surveys on con- 
structive nonlinear control by Kokotovié et al. [29, 30]. 

Regardless of these constructive methods, the last chapter showcased a collection 
of fundamental topological obstructions to the asymptotic stabilization of subsets 
of manifolds by means of merely continuous feedback, let alone smooth feedback. 
Therefore, in this chapter we briefly review a variety of proposed methods to deal with 
this situation. See for example [20] for a survey from 1995 on handling an assortment 
of topological obstructions. Since then, the focus shifted from smooth feedback to 
several manifestations of discontinuous techniques, as highlighted below. 


7.1 On Accepting the Obstruction 


Motivated by the Poincaré—Hopf theorem, early remarks on almost global asymptotic 
stabilization can be found in [28]. This notion is intimately related to multistability, 
however, now a single point is asymptotically stable whereas the rest is not, recall 
Fig. 1.1(iv). This relates to Question (iii) from Chap. 6, i.e., how does the dynamical 
system behave outside of the domain of attraction of the attractor under consid- 
eration? For example, when stabilizing an isolated equilibrium point on a closed 
manifold M” by means of continuous feedback, the material from Chap. 6 implies 
that the remaining vector field indices must add up to x (M") — (—1)". 
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Theoretically handling multistability is usually done via an alteration of classical 
Lyapunov theory [4, 23], e.g., by passing to the so-called “dual density formula- 
tion” as proposed in [44]. There, global requirements are relaxed to almost global 
requirements. By doing so, topological obstructions are surmounted at the cost of 
potentially introducing singularities. This is what we saw in Sect. 1.3. This approach 
is for example illustrated in [3], where the inverted pendulum is almost globally 
stabilized. 

Although almost global stability of some equilibrium point p* can be justified 
by the points not in the domain of attraction of p* being of measure zero, this is 
only true in the idealized setting. For instance, if one needs to take uncertainties or 
perturbations into account, even if arbitrarily small, this set to avoid remains by no 
means of measure zero. Hence, this approach cannot be categorized as robust. 


7.2 On Time-Varying Feedback 


Recall from Example 6.4 that time-varying feedback does not in general allow 
for overcoming global topological obstructions. Nevertheless, elaborating on the 
work by Sontag and Sussmann [51], under controllability assumptions, the so-called 
“return method” as devised by Coron shows that time-varying feedback can overcome 
some local topological obstructions to the stabilization of equilibrium points [17, 18]. 
Prior to the work by Coron, Samson showed that the nonholonomic integrator (6.1) 
can be stabilized by time-varying feedback indeed [39, 48, p. 566]. A more general 
and explicit approach is described in [41] by Pomet. We follow Sepulchre, Wertz 
and Campion [50] in providing intuition regarding this matter. 


Example 7.1 (On periodic feedback [50]) Consider the nonlinear dynamical control 


system 
x1 =U, 
Ý =x], (7.1) 
X3 =x}. 


System (7.1) is small-time-locally-controllable at 0 as, after writing (7.1) in standard 
form x = f(x) + g(x)u, one finds that the set 


(g(x), [FQ@), 80], LF), LF), FE), gQ II} 


evaluated at 0, spans R? ~ TR? [55]. Nonetheless, (7.1) fails to satisfy Brockett’s 
condition, cf. Theorem 6.1. In particular, see that if w(x), x2, x3) is any continuous 
state feedback aimed at asymptotically stabilizing 0, then u cannot vanish on A, = 
{x e R? : x; =0,0 < ||x|| < €}, for some sufficiently small € > 0. Otherwise, an 
additional equilibrium point would be introduced. This implies that u cannot change 
sign on the annulus A,. Evidently, a change in sign might be necessary to stabilize 
a neighbourhood around the origin, for example consider x(0) = (0, x2(0), 0) with 
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either x2(0) > Oorx2(0) < 0. Hence, time-varying periodic feedback seems a viable 
option indeed. This, to enforce a (persistent) change in sign. One can construct a 
similar story regarding Brockett’s nonholonomic integrator (6.1). To provide a hand- 
waving comment, let the system start from (0, 0, x3(0)), with x3(0) 4 0. Then, both 
u, u2 Must become nonzero, pushing both x, x2 away from 0. To make sure x1, x2 
go back to 0, both u1, u2 must flip sign, but this zero crossing (easily) induces an 
equilibrium away from 0. 


For more historical context, see the early survey paper [39] or the remarks in [19]. 

Regarding Sect. 1.3, with the aforementioned in mind, an optimal control cost 
akin to (1.2) might not be ideal as time is penalized while (time-invariant) continuous 
globally asymptotically stabilizing feedback is obstructed by x (G) = 0. Moreover, 
the almost globally asymptotically stabilizing feedback is not robust. 

As many examples before, including Example 7.1, highlight, is that some notion of 
switching is instrumental in overcoming topological obstructions. The next section 
highlights one of the most influential solution frameworks, discontinuous- and in 
particular, hybrid control. This framework is also capable of overcoming one of the 
inherent drawbacks of stabilizing (periodic) time-varying controllers: they are not 
robust, often slow and thereby costly. 


7.3 On Discontinuous Control 


As mentioned before, allowing for discontinuities in dynamical control systems is 
not an immediate remedy for topological obstructions, they can prevail [13, 37, 
47]. Yet, under controllability assumptions—fitting to discontinuous solution frame- 
works, discontinuous feedback frequently allows for stabilization [2, 16, 33, 34], 
e.g., to control the nonholonomic integrator (6.1), one can consider a sliding-mode 
controller [9]. Notably, the CLF generalization due to Rifford, allows for a princi- 
pled approach to designing stabilizing discontinuous feedback laws [45, 46], e.g., an 
explicit feedback stabilizing the nonholonomic integrator (6.1) is presented in [34]. 
See also [11] for a numerical study of CLFs with regard to the nonholonomic inte- 
grator. It is imperative to remark that under controllability assumptions, one can 
show that discontinuous stabilization schemes exist that are robust against measure- 
ment noise [53]. For an extensive tutorial paper on discontinuous dynamical systems, 
see [21], in particular the section on different notions of solutions. The survey articles 
by Clarke, on the other hand, focus more on control theoretic aspects [14, 15]. 


7.3.1 Hybrid Control Exemplified 


Motivated by the modelling of physical systems, e.g., relays, Witsenhausen was one 
of the early contributors to hybrid control theory [57]. In part due to the aforemen- 


112 7 Towards Accepting and Overcoming Topological Obstructions 


(i) (ii) 


Fig. 7.1 For Example 7.2, (i) the jump map g and the Lyapunov function V and for Example 7.3, 
(ii) the family of Lyapunov functions, flow- and jump sets 


tioned topological obstructions, however, hybrid control theory became an abstract 
theory of its own, e.g., see [25, 49, 56]. In this section we will only scratch the 
surface (Lyapunov-based switching) of what is possible using these techniques, e.g., 
in general one would discuss differential inclusions, hysteresis and so forth. 


Example 7.2 (Example 1 continued) Recall Fig. 1.1(iii), we start by introducing 
how one could study discontinuous dynamical systems. Consider a hybrid dynamical 
system on the circle S! Cc R? 


g fœ), xeC (7.2) 

x" =g(x), xED 
for C CS! the flow set and D CS! the jump set, with g the corresponding jump 
map. This means that on the set C, the system behaves as the dynamical systems 
we encountered before, but on D, the state could possibly change in a way that 
one cannot describe using C? vector fields and flows. For instance, a hybrid sys- 
tem might describe a walking robot with the jump map handling the impact with 
the ground. See [25] for how to go about solutions of hybrid systems, or see [42, 
Sect. 24.2] for a succinct introduction. Now, parametrizing a hybrid dynamical sys- 
tem in polar coordinates on S!, consider 6 = sin(@) under the jump map g(@) = € 
for some € € (0, x) with the jump set being D = {0}. Then, by means of the Lya- 
punov function V (0) = cos(@) + 1 stability of this hybrid system can be asserted 
since (dg V (0), 6) = — sin(0)* while for all 0 € D one has V(g(@)) < V (0). This is 
graphically summarized in Fig. 7.1(i). Again, we refer to [25, 42] for the technicalities 
of stability in the hybrid context. 


The approach as taken in Example 7.2 lacks robustness and is too ad-hoc for 
practical purposes. In the context of stabilization of an equilibrium point p* € M, 
a successful hybrid methodology to overcome topological obstructions is to exploit 
multiple potential (Lyapunov) functions [10]. The so-called “synergistic” approach 
uses a family of potential functions VY = {Vj}iez, Vi : M —> Rso, with p* being a 
critical point of all V;. The remaining critical points can be different, but if g* 4 p* 
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is a critical point of V; there must be a k Æ j such that V;(q*) < V;(q*). Now, if 
one switches appropriately between controllers induced by these potential functions, 
one cannot get trapped at the wrong critical point and hence p* will be stabilized. 


Example 7.3 (Example 7.2 continued) We will now follow [42, Example 24.5] and 
consider a hybrid control system on the embedded circle S! C R? and sketch more 
formally how the synergistic method works. Consider the control system x = uQx, 
where u € R and Q € Sp(2, R) such that Qx € T,S! = {v € R? : (v, x) = 0}. The 
goal is the same as before, to globally stabilize 6 = x, e.g., x’ = (—1, 0) € R’. 
We assume to have a smooth potential function V : S! > Rs» with two critical 
points, x’ at its global minimum and some other point x at its global maximum. 
Then, this potential function V is used to construct the family of potential functions 
V = {V\, V2}, as discussed above, see [35] for the details. To be able to switch 
between these functions, the state space is augmented with the set {1, 2}. Now let 
m(x) = mingen, Vax), C = {(x,q) € S! x {1,2}: m(x) +8 > V,(x)} and D = 
{(x,q) € S! x {1,2}: m(x) +6 < V,(x)} for some ô > 0, that is, we are in the jump 
set when the current selection of V, is “too large”. Now define the (set-valued) map 
&q: S! = {1, 2} by &q(x) = {q € {1,2} : V(x) = m(x)} and select the feedback 
controller, i.e., the input u, as 


W(x, g) = — (grad V}; (x), Qx). (7.3) 


Indeed, see that under (7.3), V} is a Lyapunov function for Xg on S! \ {x4} as V, = 
— (grad V, (x), Qx)? < 0 for all x € S! \ ET Xg} Note, we exploit the embedding 
S! —> R?. Summarizing, we have the closed-loop hybrid system 


J =H, g)2x.g=0,  @,q) EC 
Ves | IPSA qt = gq(x), @,q) E D (7.4) 


For the technicalities, in particular how to define 6, we refer to [35], see also 
Fig. 7.1(ii). Also note that by construction the stabilization is robust, which should 
be contrasted to closed-loop systems as given in Example 7.2. 


See for example [36, 38] for constructive results on SO(3, R), [42] for more on 
Example 7.3 and material concerning hybrid reinforcement learning and see [6, 54] 
for the hybrid approach in the context of optimization on manifolds. 

A particular instance of a hybrid dynamical system is a switched dynamical sys- 
tem [32], [25, Sects. 1.4 and 2.4], that is, a dynamical system of the form x = f, (x) 
for some switching signal o e.g., o : dom(f) > {1,2,..., N}, N € N. As alluded 
to in Figure 1.1, introducing a switch, that is, a discontinuity, can allow for global sta- 
bilization. Indeed, (7.4) is a manifestation of a switched system. See for example [32, 
pp. 87-88] for a switching-based solution to stabilization of the nonholonomic inte- 
grator (6.1). Slightly switching gears, a way to overcome topological obstructions is 
to construct a set of local controllers such that the union of their respective domains 
of attraction covers the space M. This does not necessarily result in global stabi- 
lization. The aim is rather to rule out instability by employing a suitable switching 
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mechanism. Assuming that these controllers are intended to stabilize contractible 
sets, using the Lusternik—Schnirelmann category as will be introduced in Sect. 8.4, 
one can bound the number of required controllers from below. Clearly, on S! one 
needs at least two of those controllers. 

In contrast to almost global stabilization techniques, under controllability assump- 
tions, for compact sets A, there always exists a hybrid controller that renders A 
locally asymptotically stable, in a robust sense [43]. The intuition being that measur- 
able functions can be approximated by piecewise-continuous functions and converse 
Lyapunov results can be established for hybrid dynamical systems [24]. 


7.3.2 Topological Perplexity 


As continuous feedback is frequently prohibited, one might be interested in obtaining 
a lower bound on the “number” of discontinuous actions required to render a set 
globally asymptotically stable. For the global stabilization of a point p on S!, this 
number is clearly 1 cf. Figure 1.1(i11). Recent work by Baryshnikov and Shapiro sets 
out to quantify this for generic spaces [7, 8]. The intuition is as follows, consider 
the desire to stabilize a point p on the torus T? and recall its non-trivial singular 
homology groups 

HOZ ~ Z 1 e {0, 2} l 
Z®Z ifk=1 
To globally stabilize a point, T? must be deformed to a contractible space. Then, 
roughly speaking, as Hı (R?; Z) ~ 0, this can be achieved, for example, via two one- 
dimensional cuts. These cuts correspond to the discontinuities one needs to introduce 
to globally stabilize p on T?. Now if one desires to stabilize S! —> T?, we need 
a single one-dimensional cut as Hı (S! x R; Z) ~ Z. Baryshnikov et al. proposes 
a method to quantify this approach merely based on topological information, so 
independent of metrics and coordinates. See also the algorithmic work [22]. 

In a similar vein, one can consider the work by Gottlieb and Samaranayake on 
indices of discontinuous vector fields [26]. The intuition being that Definition 1 
considers a topological sphere around 0, in that sense there is no difference between 
Fig. 1.1 (iii), (iv), i.e., one considers merely the boundary of a neighbourhood around 
the discontinuity. 
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Chapter 8 A) 
Generalizations and Open Problems get 


8.1 Comments on Discrete-Time Systems and Periodic 
Orbits 


We largely focused on vector fields, yet, in Chap.3 one observes that a variety 
of results are shown via passing to the corresponding flow. In particular, recall 
the Lefschetz theory, i.e., Theorem 3.5. Akin to Example 3.4, one can compute 
the Lefschetz number for an asymptotically stable fixed point, e.g., recall (3.7). 
Consider the (time-one) map x + Ax with A € R”*” being Schur stable, then 
sgn det(A — In) = (—1)”. However, instead of continuous-time dynamical systems 
of the form (M, R, g) one might be interested in discrete-time dynamical systems 
of the form (M, Z, y), e.g., one works with discrete measurements of the state vari- 
ables. Note, here the time-one map Y! : M — Mis enough to describe the dynamical 
system. Now, following [4, Sect. 1.11], we remark that such a discrete-time sys- 
tem corresponds directly to a continuous-time system. Define the ceiling function 
c:pE€M» 1and let M, = {(p, s) € M x [0, c(p)]}/ ~ for the equivalence rela- 
tion (p, c(p)) ~ (W!(p), 0). Indeed, M; can be a Klein bottle (see Fig. 8.11) when 
M = S!. Then, one can define the semiflow ¢’ : M; —> Mj, said to be a suspension of 
y! under c, by 6! (p, s) = (Y” (p), s’) where the free variables n and s’ need to satisfy 
n+s'=t+sand0 < s’ < 1. The manifold M; is also called the mapping torus of 
w!. One should observe that although M; and M are not homotopic, by identifying 
aset A C M witha set A’ C Mj, one can study topological obstructions in discrete- 
time via passing to the continuous-time. We note, however, that practically, hybrid 
models might be preferred over purely discrete-time models cf. [20, Chap. 1]. The 
other direction, from continuous-time dynamical systems to discrete-time dynamical 
systems finds applications in the study of periodic orbits, e.g., via Poincaré return 
maps [40]. Although we covered submanifold stabilization in Sect. 6.2, one can say 
more about the special case of periodic orbits, i.e., closed one-dimensional subman- 
ifolds of M. Here, we briefly highlight work due to Fuller. By exploiting the relation 
between the Euler characteristic, the Lefschetz number and homology, Fuller proved 
in 1952 the following.! 


' Here, a combinatorial manifold is a topological manifold, with the atlas consisting out of home- 
omorphims that are piecewise linear (PL), also called PL manifolds [44, p. 4]. 
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Theorem 8.1 (Fuller’s condition for periodic orbits [19, Theorem 2]) Let T be a 
homeomorphism of a combinatorial, compact, orientable manifold M. If x (M) 4 0 
then, T has a periodic point. 


Subsequently, Fuller provides a bound on the period [19, Theorem 3]. Theorem 8.1 
has direct applications with respect to Poincaré return maps. If the domain of such a 
map has non-trivial Euler characteristic, a periodic orbit exists. Recall that for mani- 
folds with zero Euler characteristic, the situation is less transparent, e.g., consider an 
irrational map on S!. See [7, 8] for more details and generalizations due to Byrnes. 


8.2 Comments on Generalized Poincaré—Hopf Theory 


The classical Poincaré—Hopf theorem is usually presented in its smooth form (Theo- 
rem 3.6), but as we already remarked, the same is true in the continuous (topological) 
setting (Corollary 3.1). Note that these results assumed M is boundaryless, this can 
be relaxed. Assume 0M” 4 Ø, when X € X" (M”) points inward along dM, then the 
vector field indices sum up to (— 1)" x (M”). When the vector field points outward 
along the boundary, the Poincaré—Hopf theorem is unchanged [34, p. 35]. This has 
been recently exploited to assess uniqueness of equilibria [56, Theorem 1]. General- 
izations to general vector fields being merely nonsingular on 0M have been carried 
out by Morse [37] and Pugh [43]. Relaxing the compactness assumption on M has 
been studied in [11]. For a generalization applicable to hybrid systems, see [30]. 


8.3 A Decomposition Through Morse Theory 


A smooth function g : M” — R is called a Morse function when all its critical 
points are nondegenerate. The Morse index of such a critical point p € M” is the 
dimension of the subspace on which the Hessian of p is negative definite.” Then, 
the Morse Lemma [6, Lemma 8.2.4] states that around a critical point with Morse 
index k, there is a coordinate chart (U, g) with g(p) = 0 such that in coordinates 
e(y '(x)) = g(p) — x eee a. + a4 +--+ ce Now, looking at a gradient 
vector field grad g, an equilibrium point with Morse index k has clearly vector field 
index (—1)*. A powerful application is that one can extract a cell decomposition. 


Theorem 8.2 (Morse indices and CW complex structures [6, Theorem 8.5.3]) Let 
g : M” > R be a Morse function with m; critical points of index k. Then, M is 
homotopy equivalent to a CW complex with m; cells of dimension k, fork = 1,...,m. 


As exploited in Theorem 4.2, this cell decomposition is a link to homology and 
x (M”). However, Theorem 8.2 is a manifestation of more general results, leading 


2 As discussed in Sect. 5.1, one does not need a connection to be able to perform the computation. 
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Mı 


(i) (ii) 


Fig. 8.1 Flat representations: (i) the Klein bottle (Mı in Sect. 8.1); (ii) For T? one sees via flat 
quotient representation T? = R?/Z? that cat(T?) < 2 


to the so-called Morse inequalities [28, Corollary 8.10.1]. In Sect. 8.5 we discuss a 
generalization of the work by Morse, largely due to Conley and Zehnder. Besides 
the original work by Morse [36] and generalizations due to Bott [2] and Smale [47], 
see also [33] and in particular [3] for more on Morse and his work. 


8.4 An Application of Lusternik-Schnirelmann Theory 


Lyapunov functions V : M —> Rso can be used to capture qualitative behaviour of a 
vector field X on M. For example, the critical points of V can be related to equilibrium 
points of X. Based on the topology of M, the Lusternik-Schnirelmann category can 
be used to bound the minimal number of critical points any V can possibly have from 
below, thereby, bounding the number of equilibrium points of X. 


Definition 8.1 (Lusternik-Schnirelmann category [14, Definition 1.1]) The cate- 
gory of a topological space X is the smallest n € Nso such that there is an open 
covering U;,..., Un+1 of X with each set U; being contractible to a point in X. This 
number is denoted by cat(X) = n with the cover {U;};e{n+1; being called categorical. 
If such a cover does not exist, cat(X) = +00. 


For the setting we consider, that of smooth or topological manifolds, one can 
consider a cover by open sets without loss of generality [14, Proposition 1.10]. 

To illustrate Definition 8.1, one can show that cat(R”) = 0, cat(S”) = 1 and 
cat(T”) = n, see also Fig. 8.1 (ii). In contrast to x (-), Cat(-) is not trivial for compact 
Lie groups, e.g., cat(SO(3, R)) = 3 and cat(SO(5, R)) = 8. 

For a more control-theoretic example, we return to the switching controllers from 
Sect. 7.3. If Mis “covered” by local controllers all intended to asymptotically stabilize 
some point, their respective domains of attraction will be contractible by Theorem 6.4, 
so that one needs at least cat(M) + 1 controllers. 
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Next we provide a corollary to the Lusternik—Schnirelmann critical point theo- 
rem [14] (for any smooth function over the compact smooth manifold M” it holds 
that cat(M") + 1 < crit(M") [14, 48]). For the precise definition of the chain recur- 
rent set R(x) of the flow gy we refer to [13, 26], but simply put, R(x) is the 
intersection of attractor and repeller pairs under gx. Let A be an attractor, then, the 
corresponding repeller is A° = M \ D(gx, A). Now the chain recurrent set is defined 
by M\ R(gx) = UaD(yx, Aa) \ Aas Or R(x) = Na (Aa U AB). 


Corollary 8.1 (Critical points and limits sets) Let M” be a smooth, compact, bound- 
aryless manifold. Then, if 
cat(M”) + 1 > x(M"), (8.1) 


there is no continuous vector field X € X'=°(M") with all of its equilibrium points 
{Pj hier isolated and with ind p(X) = (—1)" such that R(px) = {P} jiez- 


Proof For the sake of contradiction, there must be a smooth Lyapunov function 
V : M” — R that vanishes on R(x) = {pf }icr. Then, impose some metric (-, +) p 
on T,M”, by assumption M” admits at least one Riemannian metric. By bilinearity 
of the inner-product (-, -), on T,M” the set {p € M” : grad V(p) = 0} is invariant 
under the choice of metric (in contrast to neighbouring points, recall the example 
due to Takens [49, p. 231]). Then the claim follows directly from the Lusternik— 
Schnirelmann critical point theorem, Theorem 6.6 and [17, Corollary 2.3]. 


Although Corollary 8.1 is not surprising, one can study the gap cat(M”) — x (M”) 
in order to get a better understanding of admissible multistable behaviour on M”. 


Example 8.1 (Example 6.5 continued) As x(Gr(2,3)) = 1 and cat(Gr(2, 3)) = 
2 [1, Theorem 1.2], Corollary 8.1 applies. Hence as in Example 6.5, we recover 
that although Theorem 6.6 applied, stability cannot be global indeed. Yet, as also 
mentioned in Example 6.5, if one assumes to have a asymptotically stable equilibrium 
point, then, there must be a non-trivial limit set as well. 


8.5 Introduction to Conley Index Theory 


The index theory as developed by Conley and coworkers enlarges the scope of Morse 
theory beyond non-degenerate critical points, in particular, beyond points. 

Let us be given a dynamical system (M, R, g). A Morse decomposition of a com- 
pact invariant set A C M is a finite collection of compact disjoint invariant subsets 
Ni,..., Nn of A such that when p € A \ Li Nj there are indices i < j such that 
a(g, p) C Ni andw(g, p) C Nj. Such an order on Nj, ..., Na will be called admis- 
sible. Then, given a set S C M, let 7 (S) = {p € S : Y(R, p) Z S} denote the subset 
of S that is invariant under the flow g. A compact set N C M is called an isolating 
neighbourhood when I(N) C int N. Then, a set S C M is an isolated invariant set 
if S = I(N’) for some isolated neighbourhood N’ containing S. 
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Definition 8.2 (Index pair) Let S be an isolated invariant set. Then, the pair of 
compact sets (N, L) with L C N is an index pair for S when 


(i) cl(N \ L) is an isolating neighbourhood of S with LN S = Ø; 
(ii) L is positively invariant in N, that is, if p € L, then ọ([tọ, tı], p) E N implies 
g(lto, ti], p) E L; 
Gii) L is an exit set on N for ọ, that is, if p € N and there is a t’ > fo such that 
y(t’, p) £ N, then there is a s € [fo, t’) such that o(s, p) € L. 


Now, let S be an isolated invariant set, with N1, ..., N, an admissible Morse 
decomposition, then, there is a collection of subsets Mo, Mı, ..., Mn, called a 
Morse filtration such that M, C - -- Mı C Mo and wheneveri < j, then (M;—1, Mj) 
is an index pair for Ni; = {p € S : a(ọ, p), œ (Q, p) © Ni U Nizi U ++- U Nj} [27, 
pp. 76-77]. Evidently, (Mo, M,,) is an index pair for S. 

Then, the cohomological Conley index for an isolated invariant set S with index 
pair (N, L) is defined as CH (S) = H(N, L). Similar to what was discussed 
in Chap.6, the (co)homological Conley index can be used to provide for exam- 
ple necessary conditions for an equilibrium point to be asymptotically stable [13, 
Sect. 1.4.3], [25, 38]. In this sense, CH (S) is analogous to the vector field index. 

More generally, the Conley index can be defined as A(S) = [(N/L, [L])], that 
is, as the homotopy type of the pointed space (N/L, [L]) [27, 46]. Although effec- 
tively intractable, in contrast to CH (S), the Conley index A(S) allows for a result 
analogous to the Poincaré—Hopf theorem. To that end, define the relative Betti 
numbers as b(B, C) = rank H*(B, C; Z) = rank H;,(B, C; Z). Additionally, set 
p(t, B, C) = } ~o ke (B, C)t*. If (B, C) is an index pair for some isolated invariant 
set A, with some abuse of notation put p(t, h(A)) = p(t, B, C). Under this notation, 
the following is a generalization of earlier work due to Morse. 


Theorem 8.3 (Conley index theorem [27, Corollary 2]) Let A C M be a compact, 
isolated, invariant set and (N4, .. ., N,) an admissible ordering of a Morse decom- 
position of A. Then, 


Pe A(N;)) = p(t, hA) + A+A), (8.2) 


n 


J 


noindent for Q(t) a polynomial with non-negative integer coefficients. 


We remark that Q(t) depends on the chosen decomposition. Theorem 8.3 implies in 
particular that for a dynamical system (M, R, g) over a compact manifold M one has 


xM) = (DS (Mj-1, Mj) (8.3) 
j=l k>0 
noindent for some Morse filtration Mo, M1, ..., Mn. See that (8.3) is inherently 


coarser than (8.2), i.e., the excess term Q(t) cancelled out. Also, when M is com- 
pact, the trivial decomposition N; = M and the trivial filtration (M, Ø) are always 
admissible. 
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(ii) 


Fig. 8.2 (i) Example 8.2 with Morse decomposition (N1, N2) and Morse filtration (Mo, M1, M2); 
(ii) Example 8.2 with a coarse decomposition, see the equivalence through the lens of this decom- 
position. Also see that the rightmost figure is a typical instance where (8.1) holds with equality, 
that is, the vector field under consideration does exist here 


Example 8.2 (Admissible flows on S?) Recall Fig. 6.4, we will apply Theorem 8.3. 
First, a Morse decomposition is given by (N1, N2) with orbit VN; = O and equilibrium 
points Ny = {py} U {p3}. Then a Morse filtration M) C M, C Mois given by Mọ = 
S?, M; the disjoint union of sufficiently small compact spherical caps around pi and 
p3 and M) = Ø. see Fig. 8.21. 

Only indicating non-trivial homology groups, as Hy (Mo, J; Z) ~ Zfork € {0, 2}, 
Hy(Mo, Mı; Z) ~ Z fork € {1,2} and Hp(M), M2; Z) ~ Z? we find that Q(t) = 0. 
Note, here we used the wedge sum, i.e., Mo/M, = S? v S! [23, p. 10]. One could 
consider a coarser decomposition and ignore Nj, i.e., group pj, p> and N’ as Fig. 8.2ii. 
In that case, Q(t) = 0 and one effectively employs the Poincaré—Hopf theorem. 
Consult also the discussion in [27, Sect. 3.5]. 


Besides the original work by Conley, Zehnder and others [12, 13, 46], see [27, 
35] for introductory works and for example [45] for a discrete-time analogue. Also, 
the work by Conley et al. builds upon that of Wazewski [54], [22, p. 280], which has 
been recently exploited in [41, 42] to provide further local obstruction theory. 


8.6 Conclusion and Open Problems 


This work aimed at providing an overview of how topology can provide for unique 
insights in control theoretic problems. This approach has a long and rich history 
and we believe this work shows it has more to offer for the future. In particular, 
Borsuk’s retraction theory and the application of homotopy- and index theory akin 
to the framework by Krasnosel’skii and Zabreiko provide for a fruitful and unifying 
approach towards a mathematical control theory. We end with potential future work. 


(i) Sufficient conditions: Controllability assumptions, the existence of a control- 
Lyapunov functions or structural properties like homogeneity can be exploited 


8.6 Conclusion and Open Problems 125 


to provide sufficient conditions for certain feedback laws to exist. It would be 
interesting to see to what extent these results can be generalized to work for 
general control systems, e.g., E = (M, U, F), aiming at locally asymptotically 
stabilizing some closed set A C M. To that end, one needs to assert that A can be 
rendered invariant, there exists a dynamical system such that A is an attractor, 
locally, and so forth. Hence, sufficient conditions, especially conditions that 
lead to the construction of controllers are of great importance, yet, with the 
remarks of Casti [9] in mind, universal conditions might be too optimistic. 
Hence, a sub-question entails finding (more) appropriate classes of canonical 
control systems. An operator-theoretic start of this program is presented in [10]. 

(ii) Numerical tools: This line of work aims to provide necessary and sufficient 
conditions so that one can assess—a priori—if a stabilization problem has a 
solution. Clearly, these conditions must be easier to check than a brute force 
numerical experiment for this to be of practical value. In this regard, apply- 
ing tools from computational homology [29] seems interesting. However, one 
might obtain corrupted information regarding the control system, e.g., F is 
based on experimental data. Recalling Remarks 6.1 and 6.5, computational 
tools must be able to provide certificates of accuracy, e.g., see [53] and refer- 
ences therein. Here, the field of topological data analysis (TDA) is also ought 
to play an increasingly important role. For instance, if one can sample points 
from Q, as in Theorem 6.3, TDA tools can be used to estimate if (6.2) is true. 

Gii) Other invariants: Although finding the “perfect” invariant that allows for clas- 
sifying dynamical systems up to conjugacy (Smale program) is too ambitious,” 
one might look for new invariants that capture (some) qualitative behaviour of 
interest. Related is the question, largely due to Conley, as posed in [31], can 
the homotopy from Theorem 6.13 be chosen to be asymptotically stabilizing 
throughout? Here, relaxing the notion of (uniform) asymptotic stabilization 
provides for many counterexamples cf. Fig.3.4. We also believe that impos- 
ing restrictions on the class of Lyapunov functions to assert stability might be 
insightful. Moreover, it is not clear how to meaningfully extend this type of 
theory to generic input-output systems. In other words, can a similar program 
be outlined for general systems, going beyond dynamical systems cf. [21]. In 
particular, a program that allows for compositional thinking. Here we note that 
especially homology appears suitable, i.e., (G2 o Gi), = Ga, © Giy. 

(iv) Nonlinear system identification: Our understanding of statistical finite- 
trajectory nonlinear system identification is improving, e.g., see [57], yet it 
is unclear how to go about identifying a nonlinear system (or equivalence 
class) globally. In particular, unstable equilibria are hard to identify. From 
Theorem 6.6 it follows that if one assumes that all unknown equilibria are 
asymptotically stable and the system is noiseless, then, one needs at least x (M) 
trajectories to “identify’* these equilibria and their respective dynamics, locally. 


3 See for example [18] for related studies of the conjugacy problem in ergodic theory. 


4 Defining precisely what this means without resorting to questionable parametrizations is also 
largely open. 
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Combining the topological viewpoint with TDA and modern high-dimensional 
probability theory, e.g., [52], could be a fruitful combination. Other popular 
methods like neural networks, Gaussian processes, and so forth, all require 
further development of the theory. A promising direction exploits Koopman 
operator theory [5]. 

(v) Feedback invariance: As set forth in the monograph by Lewis [32], the lack 
of feedback-invariance present in most of the literature obstructs a principled 
control theory. In particular, the key necessary condition for control, that of con- 
trollability, is not invariant under feedback reparametrizations, see also early 
comments by Willems [55]. We also put emphasis on results that do not rely 
on the control system at hand, but merely on the underlying manifold M and 
the set A that is deemed to be stabilized, cf. Theorem 6.12. However, a vari- 
ety of results, mostly contained in Sect.6.1.1 do rely on the control system 
parametrization. 

(vi) Stochastic systems: One can generalize Definition 5.5 to include distur- 
bances [39, Definition 13.26]. Obstruction theoretic results that do include 
some form of noise often focus on moments [15, 16], however, how to extend 
the theory in the most meaningful way to stochastic systems is not clear. 

(vii) Zero Euler characteristic: Set with zero Euler characteristic are inherently dif- 
ficult to handle, cf. Theorems 6.5, 6.6, 6.9 and 6.11. As these sets are, however, 
abundant (odd-dimensional manifolds, Lie groups, periodic orbits), more the- 
ory is needed. Recalling Remark 6.4, retraction theory is of use, at the cost of 
being largely independent of the control system at hand. One could also look 
for other topological invariants that allow for a better classification of these 
sets. 


More questions remain, conceptually, why are odd-dimensions seemingly inherently 
obstructive? What can be said about finite-time stabilization? How can we further 
integrate the structure of U and F in the analysis (beyond Theorem 6.14)? For 
instance, to get a better grip on Question iii. Most importantly, more topological 
obstructions are likely to be found. For example, one might use that for closed 
topological spaces X and Y it holds that x (X u Y) = x (X) + x (Y), or by using that 
an orientable manifold M” has even Euler characteristic if n is not a multiple of 4 [24, 
Theorem 1.2]. Or less recent, a closed connected smooth manifold M has x (M) = 0 
if and only if it admits a smooth codimension-1 foliation [51, Theorem 1]. However, 
more impactful ought to be obstructions derived from Conley— and Morse—Bott 
theory or obstructions applicable in the context of robust- and hybrid control theory. 
In particular, theory well equipped to handle input-output systems. Although progress 
has been made with respect to obtaining a principled approach to stabilization on 
Lie groups [50] cf. Sect. 1.3, the central problem remains that of finding tractable 
sufficient conditions—as stressed throughout the literature [10, 31]. In particular, 
sufficient conditions that lead to implementable controllers. Ce n’est pas tout. 
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